Decaying Smite Armor Value Problem?

Using the Decaying Smite blessing to remove physical resistance as shown in the photos, the enemy gains an armor point. This wouldn't be that big of a deal except it's the one point of armor that is preventing me from winning after spending more time than I'd like to admit on finding a path to victory.