Heart palpitations on starting?

Is it common to have what feels like heart palpitations/heavy heart beat when starting? My mind is already less anxious (woohoo!) but I still have this feeling in my chest almost all the time. I can distract myself during the day, but it bothers me more at night when I'm trying to sleep. Is this common and will it go away? Thanks