Are Elder Vampires really that bad?

As an Ascended Elder Vamp, going Warlock in the Dark culture (Cult of Tyranny) and the society traits Cult of Personality and Vision of Ruin (Shadow): I find the game snowballs easily from beginning to end. I have the Ascension Trait that gives a Skeleton unit with Unholy Champion specifically for early game + EV Desecrator (gives Zombie servant every fight as well) and Profane Body Mastery (for more Evasion stacking, movement, and +20 HP).

I don't really understand some people insist that Elder Vampires make bad Rulers. Can someone enlighten me please? Whenever I meet the criterion for Age of Death, I have never lost a game.