Equipping a wand unsummons my skeletons.

Is this supposed to happen? I have some skeletal clerics that disappear when I equip my wand (wand+sceptre offhand), but appear if I unequip my wand - they also appear even if I unequip both my wand and sceptre, so it isn't an attribute or spirit requirement issue.