Can’t respec oathbreaker

I’m trying to become an oath breaker but I want to respec my attribute points and multiclass. I break my oath reclaim my oath then I can’t respec into oathbreaker. I also can’t break my oath and respec with the oath broken debuff on. I guess I just can’t respec as an oathbreaker?