Unable to Complete Gwylan Quest

So I have the bunny suit quest where you have to wear the outfit - easy enough. The issue is the quest includes the bunny collar and I already have the familiar collar. I can't have Gwylan take it off because I have to finish the quest first.

Am I basically SOL and stuck getting super stressed out by not completing the quest?