You have completed your intermediate 3 year before with mathematics and you chosed  Engineering as your career, so don't leave it now if chosed it stick with your decision. You have completed 3 years of your engineering that means 6 semester only 2 more to go. So focus on your studies.
Think in a way that after one more year or 2 semesters you will have a engineering degree in your hand but if you leave it now your three years are wasted and now you have to start again from beginning. So complete your engineering then persue other course to be on a safer side.