Emoji suggestions

I don't know if this has come up here on the sub before but I use emojis a lot on the Mac (Command+Control+Space) and MacOS keeps suggesting emojis depending on the last word I type - and more often than not (not to mention nearly always), it suggests an emoji I don't want every time I press the keys to open the emoji panel.

Is there a way to turn off that 'suggestion' MacOS always makes or this is a default thing and we all just have to deal with it?