Hi Varsha!
First of all, a very hearty congratulations to your brother for his rank. In the general category, the cut-off marks for MSC Mathematics are 22.96. So, if your brother's marks are above that, then he will definitely get an admission in an IIT for MSC Mathematics.
Let me know if this answer was helpful and wish him all the very best for his future!