CrossWorlds: Does anyone else feel like boosts do nothing?

There's been several times where I've used a boost wisp or boost pad and just couldn't catch up to the person in front of me. Or times where people have passed me AT THE FINISH while they didn't have boost and I did. I know there's a speed stat, but it seems kinda absurd that they outclass my speed + boosts that much.

FYI: I only use speed cars and Extreme Gear and swap between characters.