Ear ache

Male, age 40, no medications.

I have experienced multiple bouts of ear aches in my right ear for the past year and a half, sporadically (ie, the pain flares up every few weeks, lasting a few hours, then gradually subsides). The pain is more prominent in cooler temperatures, below 70° F. The pain worsens the colder it gets. My PCP examined my ear and said there was no wax build up and no infection. He suspected allergies as a contributing factor. I honestly haven't taken an allergy meds, but I'm curious if these symptoms could also indicate some other condition. Any thoughts? Any recommendations?