Dear Student, 

Yes, you can definitely appear for Jee mains even after taking admission in any private college if you wish to know your chances of getting into a government one. Private colleges do usually start admission procedures early to get students before they get into any government college but you can definitely appear for Jee mains and go for a government one and leave the private one. 

Hope this might help you.