Exclusive Magic Build

Okay so for the first time ever I'm playing an exclusively magic build. No weapons unless a battle is made downright impossible by magic only (ie Morokei in the College of Winterhold quest line). I've been using heavy armor but for this type of build would light armor function better?