What does it take to boot the Speaker of the House?

Wasn't Kevin McCarthy called out by a single Rep? Can't they punt Munchkin Mike?