Shaking your leg means you're anxious

It's more so just a very small pet peeve of mine. Whenever sitting down for a long while or waiting somewhere, I shake my leg as to just numb my boredom when waiting. To others though they assume I'm anxious about something and though I appreciate being asked this, it is never the case. It just gets annoying being asked this whenever a friend or family member notices me shaking my leg.