Should I go to the hospital for pulsating in my ear and a headache?

About three hours ago, I started feeling a pulsating sensation in my right ear. It comes and goes, but it’s there most of the time. It feels like a heartbeat or like there’s water in my ear, and it matches my actual heartbeat.

Now I also have a throbbing headache on the right side of my head. This is the first time I’ve ever experienced anything like this.

Has anyone had this before? Should I urgently go to the hospital, or can I wait and see if it goes away?