AirPods answering calls

Want to stop gestures and “yes” from being things that will answer incoming calls.

I have already disabled gestures but can’t seem to figure out how to disable it for my voice.