Does anyone else’s Quaker fly attack them pretty frequently?

Mine probably fly attacks my head every 3mins. He suddenly makes a really mad face and flys to my head. I always have to wear a hoodie when he’s out. I’ve tried paying attention if I do something but I’ll just stand there and watch him and he does it or I’ll stand there and pay no attention to him and he still does it. He gets 14hrs of sleep, tops pellet diet, and plenty of toys and foraging opportunities all day. I’m pretty much always on edge and watching his next move when he’s out and it’s not enjoyable.