Call from studentaid.gov worried about possible scam

So I got a call earlier today from studentaid.gov talking about loan forgiveness but the person didn’t immediately introduce themselves and had a foreign accent (I know many in the US outsource these things, I’m not trying to be prejudice when I say this but it does add the the paranoia in this case) so I figured it was a scam and hung up, but I got another call an hour later and I entertained it until he was pressuring me about an email with a code I needed to give him but the email was taking awhile and I asked if I could call back because I was working and had to get back to it. He gave me his supervisors name and direct line. Then she calls me immediately… I answer all the questions, they got into my studentaid.gov account and fed me all the information that was there. I ended things when they started asking for my banking info but now I’m worried I gave them name DOB and SSN that was in my profile. All the emails did come from studentaid.gov I looked them over thoroughly and I do security training for work monthly, I know what to look for and all the emails looked legit.

Anyone else deal with this? Is it a scam or legit, I really can’t tell. I did fill out some things for the Save plan a few months ago.