Is it really RTO if you never went into the office?

Is there any argument that you can’t return to the office because you’ve never been there in the first place. I was hired remote but told my position was not classified as remote but I was only “allowed” to work remote. Now RTO is 8/10 days and the only positions that are classified as remote are a few of the senior spots.