Is mage damage worth it?

I know upgrading the different armors allows you to add enchantments, but is the overall attack boost worth investing in or is it better to focus gold on leveling spells up instead?