Guardian keeps remembering then forgetting space

We changed up our living room a little and my Quest will recognize the area and then not recognize it a few seconds later.

Every time I go to reset it, the Quest recognizes the area halfway through the setup and interrupts the process. It's kinda comical to restart it over and over and try to race through the procedure but I haven't been able to finish.

Is there a way to force the Quest to forget the Guardian without a Factory reset?

I have to play in another room with much less space. :(