Should I break up w him?

So I'm a high schooler and I recently went on my first date with a guy. We were friendly for awhile and he was super nice and fun on the date. But I've heard a lot of stories from very trustworthy friends that he's been incredibly mean to them, constantly teasing them, making them feel like shit, not stopping when asked, stuff like that. He also has very few friends and I feel like I'm the only person in his life. He's VERY attached to me for it being only one date and texts me on the daily. We're not official or anything, so part of me feels I should do it before things get to serious, if they haven't already. What do yall think?