Good idea, bad idea, or impossible idea?

So, I've got the Master Thieves' Armband and just ran into the Old Wandmaker.....can/should I rob him? Or will he zap me into oblivion? NOTE: it does not matter if he faffs off into the mist, it's the rotberry task, so I can just use it for strength.