Is magic broken?

When I play as a wizard, at higher levels my magic feels like I'm shooting cotton balls at my enemies while every single spellcaster spams infinite spells and one shots you?

Is this a git gud situation or is there a way to deal more damage past lvl 100 spellcasting and magic while taking on mages as a melee character?