How To Stop Repetitious Phrases When Speaking

Not sure if that title is worded correctly, but I couldn't think of another way to say it.

What I mean is that I've gotten into a bad habit of saying "you know" frequently whenever I speak. I have no idea where I picked it up from. So for example, my speech will often sound like:

"So I said to him, y'know...and then he said, y'know...so I thought to myself, y'know...I just feel like, y'know..."

Basically I'm interjecting "you know" into my conversation excessively where it doesn't really belong. I can hear myself doing it and it bothers me, but I can't stop myself - I just say it. I've always been a fairly good talker and never really had stutter or a quirk or something like this before.

Is there a way to train myself to stop doing this? I know this is a pretty minor thing on a subreddit full of pretty significant things but it's just one of those little things about myself that bothers me. Any advice would be appreciated, thanks!