Does ally potential/potency ever decrease?

Because, damn, it feels like I'm doing something wrong when the cute fairy is tankier than I am.