How to invite former member as a GUEST?

It seems like every time I try to remove a previous member and then re-add them as a GUEST to specific pages, it shows the green icon instead of the orange guest one, and tries to add them as a member to the workspace.

(If it matters: intended guest has same email domain as the overall workspace.)

Is there any way to manually set them as a guest?

I'm expecting Notion support won't give me an easy answer here.