what are the chances that I give my partner hsv-1 through oral without an active breakout?

I have HSV-1 coldsores that pop up maybe once a year... maybe twice if I'm having bad luck. I've actually gone a year or two without having outbreaks or anything trigger my coldsore and I have one spot on the top of my lip that i KNOW when it is going to pop up.

I recently read that you can give your partner herpes regardless if you have an active breakout or not and I am actually scared now. So is it true that if i gave my partner head while clear and having no breakout (especially if I haven't had one in years) that i can end up giving him genital herpes??? If this is true he's never getting head again. lmfao.