[TOMT] Old anime I only watched a few episodes of

Years back, I had a VHS or DVD of a show. It had a blonde boy, I don't remember his name, but he was in middle/high school. He wore glasses and wasn't athletic. Middle of the school day, a door opens up in his classroom and he goes to another world where suddenly he doesn't need glasses and is also suddenly athletic. Thee magic system there was focused on enchanted artifacts. The boy finds a weapon like a cup and ball/hammer game. It has a mustache and talks.