My caretaker left me and my brother on the side of the road, am I in the wrong?

Me and my little brother have a caretaker. She’s a family friend and has two kids of her own (19 and 24) so you’d expect she know how to properly deal with kids. My brother is 9 and I’m currently sick. So when we were playing in the backseats she kept looking back at us and told us to stop fighting or she’ll make us get out. We obviously thought she was just threatening us like she normally does, so we didn’t expect when she pulled over on the side of the road about 2 streets away from our house and made us get out. It’s raining and my brother doesn’t have shoes, there’s lots of broken glass and stones on the ground and she makes us get our bags and walk home while she drives off to our home while to have a chat with my dad like she always does, picks us up from school (although I have to walk to her house which takes about 5 minutes depending) drops us off at home and won’t leave for a good half hour while she talks to our dad. I hate her, I always have and my parents don’t do anything about it, worst thing is they’ll take her side since she’s an adult. I text my mum telling her I’m walking home tomorrow, which takes 1 and a half hours, calling her a bitch and that I won’t be going with her. Im planning on staying in the library for half hour after school and then walk home, my mum doesn’t like the fact I called her a bitch despite the fact I made it extremely obvious I didn’t like her as a child. Am I in the wrong for calling her a bitch and being rude??