Stressing over a situation today in class - need advice

So today, I was teaching my class, where a student who is SEND student has been let back into this class. It's a very high set class btw. There are 30+ students here.

I am new to the school as a teacher and today whilst I was explaining something on the board, he kept sticking his tongue out and making funny faces at others.

A couple of lessons before, he kept making loud fart sounds to cause disruption when I am explaining things on the board.

As he is SEND, I have been relaxed on applying detentions to him. But today, it was an important lesson where students were making corrections on their exam papers, and so I just told him why are you behaving like an idiot.

Then he raised his voice and shouted when I told him to look towards the board, so I told him to get out of the class.

The thing is, he is a competent student, his issue is not so much learning difficulty than it is behavioural.

Looking back I shouldn't have spoken harshly. I also have sent him out in the past once similarly.

When he was sent out, he went straight to SEND, he didn't even stay outside the class, which I would have let him back in a couple mins later.

Could I be in trouble for how I spoke today? Someone told me using the word idiot could amount to gross misconduct - of course, I didn't literally mean it; it was just frustration in the moment.

Can anyone give me advice on what I could do? I don't know if it's too late now and I could be in trouble