Cat keeps attacking my face

Background: We have had our two cats since they were only a few days old (started out as neonatal fosters) and they both just turned a year on Monday. Our male cat, Spike (aptly named), has had some digestive and constipation issues, for which he is on a twice-daily prescription medication as well as an OTC laxative. Per shelter rules, they were both spayed/neutered at 8 weeks old.

Other than being unceremoniously dumped on someone’s lawn at a few days old, these cats have never experienced a day of hardship in their lives. His sister is an absolute angel (and he’s an asshole to her as well, constantly trying to assert dominance, in which I intervene if it becomes too aggressive). They are provided for and doted on in every possible way. We treat them like our children.

Unfortunately, he has developed some aggressive behavior and has now attacked me in the face twice (with many other threats of violence via growling and swiping). The first time was when I was holding him by the back door and looking out in the yard together. The second time was this morning was when I picked him up to bring him inside from our apartment stairwell. Basically any time I go to touch him or pick him up when he’s not in the mood, he will try to attack me. In my face. Since the first attack, I have tried to be more tuned in to his emotional state, but the problem is, sometimes I need to pick him up when he’s not in the mood. When he’s not being a little brat, he’s a perfectly sweet cat, though he requires a lot of stimulation and play (not unusual).

Has anyone had experience with something like this? Is this common for male cats, and he’ll eventually grow out of it? Is there anything I can do to effectively curb this aggressive behavior?