According to the new policy of Government of India, you can pursue two degrees simultaneously nowadays. So, if you are pursuing Computer Science and Engineering right now and want to do BSc Physics out of your interest, then I think that you should definitely go for it. Look out for soma colleges which can complete your course in distance mode and then you'll be good to go!

Hope I have answered your question. All the best!