Relationship Vs. Friendships? Little help?

My boyfriend and I have been dating for 3+ years. We've had quite a few issues with trust mainly and him being behind on certain life events like school and work. His friends never had a problem with me until it became a problem and he began to put them first and choose them over me. Three friends, more specifically, like to bother me and purposely say things to try and make us fight. I'm very short tempered and try no to let that bother me sometimes, but they don't quit. This last time I brought it up to him asking him why they do that? I don't even talk to them directly but they find ways to bother me. He got upset with me and doesn't want to talk to me because he went to hang out with them...is this ok? This happens frequently because of them...and a certain friend who tells him I'm crazy and controlling..What do I do? Someone talk this through with me..please :(