Government jobs document verification in india plays important role for selection it's crucial that the information on your documents should be same as information provided by you in your application form. Any discrepancies between your caste certificate address and your permanent address may raise concerns during the verification process.

As you mentioned that there is district issue on your certificate this is not big issue you can submit affidavit at the time of document verification and ensure them that you provide them new certificate within stipulated period of time.