Annoying tone in my ear when I'm on a call?!?!

I have a Motorola Fold and when I'm on a call and I get a text message or some other notification that has a sound, I get an annoying ding in my ear. How can I turn this off?