No, that is against HIPPA laws unless you have given signed written consent. Which you can revoke at anytime and if your doctors are providing medical records to anyone without written consent and after revoking written consent, they are in huge trouble.
I believe you can also ask said doctor whom has requested medical records and when. Each doctor has a medical records team who keep track of that (typically). Your job can be in trouble for asking for them without an obvious accomendation reason. And typically for an accomediation, you are having the doctor fill out paperwork. They don't request more info directly from your doctor. If they need more info they give you paperwork, advise what the info is. You give that to your doctor to provide the more info and then give it back to your job. I cannot think of one reason a job should be reaching out to your doctor directly.
There are also accomendation laws and how medical accomediations are to be handled. I would google those. And if there is any breaking of HIPPA or of the accomendation laws, I would seek help from a disability attorney. Those laws are there for your protection.