My best friend is an Imperial soldier/Guard (Civil war spoilers)

I had Just killed Ulfric Stormcloak, the assassin of the High King, and i was going to sit on his throne. I then accidentally stole a plate. Now im walking around and an imperial soldier, who is now a Windhelm guard, is 'pursuing' me for my bounty of 2, except when he gets to me he stands there and says something along the lines of "We sure showed 'em eh? Thanks for your Part in all that" or "We destroyed the Stormcloak Traitors".