Cat is overly aggressive and attacks me, I don't know what to do

My cat is 2 years old. He was recently neutered and he's an indoor cat, but he likes to escape a lot. Just tonight, he got out twice, and the second time brutally attacked me when I tried to pick him up and bring him inside like I usually do.

I did have to carry him awkwardly the first time (slung over my arm), due to having my hands full, and I'm worried I hurt him? He's normally a bit aggressive, but in a playful way, never like this. He even snarled at my grandpa, who's his favorite person.

I'm scared there's something wrong and we'll have to rehome him. He's my baby and I bottle-fed him, but if he attacks me again I'm scared my mom will think he's dangerous. She loves our cat, but I was crying from pain and heartbreak a lot (I worry that he hates me a LOT), and she's swayed easily if I'm upset.

I just want to know what I did wrong and how to fix it, and make my cat happy. I don't want him to be rehomed.