Do you rate a passenger low if they have kids with them?

I have a 4.76 passenger rating, with 26 5 stars, one 3 star, and one 1 star rating. I have no idea how I got the low ratings, as I always tip, don't make the drivers wait, I'm polite, etc. The only thing I can think of is that on occasion I will bring my two kids with me and their booster seats. Is this something that drivers would rate me lower for? The kids are well behaved, they don't act out in the back seat or anything.