Hi Veena

Some of the important books for IIT JAM Mathematics are :

Mathematical Analysis - S.C. Malik
Mathematical Analysis – Apostol
Principle of Mathematical Analysis - Rudi

Mathematical Analysis - H.C. Malik
Calculus - Thomas & Finny
Integral Calculus- Gorakh Prasad

Geometry & Vectors – Vasishtha
Calculus – Thomas & Finny

Real Analysis – H. L. Royden

Refer to the link below to check the complete list of books :

https://university.careers360.com/articles/jam-how-prepare-for-mathematics

Hope this helps.

All the best !