Still can't find a VLM that can count how many squats in a 90s video
For how far some tech has come, it's shocking how bad video understanding still is. I've been testing various models against various videos of myself exercising and they almost all perform poorly even when I'm making a concerted effort to have clean form that any human could easily understand.
AI is 1000x better at Geo guesser than me but worse than a small child when it comes to video (provided image alone isn't enough).
This area seems to be a bottle neck so would love to see it improved, I'm kinda shocked it's so bad considering how much it matters to e.g. self driving cars. But also just robotics in general, can a robot that can't count squats then reliably flip burgers?
Posted Sep 28, 2025, 1:35 PM UTC
933