Rinku, based on your previous question, we are guessing that it is UPSC instead of IOSC. The eligibility to appear for UPSC exam is to complete your Graduation in any discipline. Which means that there is no specific stream that you need to complete your Graduation in. So just to  answer your question, you can appear for UPSC examination even after pursuing B.Sc Mathematics.