Did my mom legally fuck me?

Location: California

So I know this will never see the light of day in court but I am just curious if I got legally fucked as a child. Here is rundown. I (42m) , and my little brother who is deceased now were both put into foster care immediately after being born due to having a heroin addicted mother. Our biological father who died before my lil brother was even born and I was less than a year old. He was Vietnam vet. So me and my brother lived in foster care until we were adopted when I was 5 and my brother was 4. Thank God we got to be adopted together because my brother was pretty much the only real family member I ever felt like I had. Anyways we got adopted into a good family that made sure our needs were met. My adopted father died when I was 15. My adopted mom found a new husband in about six months and left the state and left us , but allowed us to live in the house until we finished high school. She was very blatent that we were nothing but a burdon to her and even told me when i was 16 that I was like old luggage she couldnt get rid of. But anyways the whole time throughout my child hood me and my brother recieved social security checks from my biological dad being a deceased Vietnam vet. We were always told that the money was getting deposited into a savings account for us for when we turned 18 and that way we could go to college. And I believe that was true up until the day my adopted dad died. Because once he died and my adopted mom moved on to a new life all that social security savings account college money talk vanished along with the money and neither me or my bro saw any of it.. I am just curious if this was legal or did me and my lil bro get royally fucked? This was over 20 years ago so I realize I dont have any legal leg to stand on, I'm just curious and have done a lil reading online but cant really come to any definitive conclusion. I appreciate any input on thisl. Thank you.