If petitioner gains posession of the residence but then leaves, am I still not allowed in?

Location: Virginia

Of course I'm not going in the house. The homeowner and the pastor of the petitioner are telling me to go inside. Petitioner has moved in temporarily with the pastor and their family. No domestic violence took place between us.