Balgruuf is pissed bug

I'm doing the civil war quest for then imperials and just finished the battle for whiterun and I get the quest update to listen to Balgruuf's speech. However, I don't have the quest notification turned on so I run up to dragonsreach to try to find him, realise I messed up and head back outside. He's there, I listen to the speech and all is well. However, I have to log off so I save the game and leave.

The next time load it up Balgruuf is pissed. He and Irileth start wailing on me while the guards just stand and watch. No problem, I'll load the autosave from going through the main gate and just listen to the speech again. Nope! He's still pissed. Maybe if I reload the autosave from when I left dragonsreach? Nope, still pissed. Along with a random priest for some reason. Not the guards though, they're still chill.

So I ended up loading my original save and running away to solitude. I suspect Balgruuf still wants me dead but should make the rest of my playthrough interesting I guess! No idea why this has happened. Funny though.