Villagers acting weird

So I’ve been trying to get a zombie villager and I finally got one to convert, he was being finicky with the jobs but whatever. Finally got him to cleric, trade with him to lock it in and then I go over to my house for a sec and his level progress had reset. I thought maybe it needed to be a level up so I leveled him up to 2. Go back to my house to grab some blocks and now he’s a weapon smith??? What am I missing here. I’ve broken all of the weapon smith blocks and he just seems to be stuck as this.