Would it be wrong to drop a class for something small?

So I have this professor who constantly cuts me off when talking, ignores me when i try to participate and today accused me of not doing any work and helping my group members on a large project we've been working on all semester. Bassically all my work is submitted on blackboard as evidence but he believes I still don't do work despite my graded work.

I dont know what or why he has a problem with me, I sit in front, respond when I can, do my work, write notes and for our group project I was the first to watch the film for our assignment. Asigned roles, made the presentation template, did the themes and questions and interests and summary, let my team members do the bare minimum because their lazy.

And I got accused of doing none of It, not seeing the movie, and not helping my team or taking time to work on the final project which I will admit I didnt but thats because I have five other classes I have essays and projects for and the due date is a week away but my team members also haven't done anything because their waiting on me. He by the way doesn't excuse only one person doing the work while others slack off because he sees it as group effort. We'll all the same grade and ill be blamed for it.

And he gave praise to the boy of the group who didn't even watch the movie fully and I think my professor thinks the boy also did the presentation. And i can never explain myself because he either cuts me off or talks fast and it throws me off guard. Anyways today he got close to my face squatting down to my level in front of the class stared at me intensely told me im slacking, not sure how I have absences (sometimes i skip his class to do other work which is my fault completely i take blame for that. I know i shouldnt have but sometimes the workload gets heavy) and I need to help my oh so hard working team members and if I wanted to pass his class I needed to get myself together and do it and then told me i can leave now. Which I did and cried.

(Mainly because my months of work was credited to my team and thought that i did nothing.) Hes constantly acting this way towards me and Ive been thinking on dropping out after I had to make a report because I ended up crying in the car to which my dad dragged me inside to talk to the office. And they had to make a report since i was in distress. Which was absolutely embarrassing but i do have to admit this is putting stress on me. Still is. Anyways would it be wrong? Or should I tough it out?