How do I add doors/windows on switch (I’m desperate)

I can SEE the door and window icons with the little plusses. They’re taunting me, because I can’t figure out for the life of me HOW I press it on the switch