Removing a soap dish from shower wall

We have a soap dish on our shower wall that we'd like to remove ourselves if possible. Here are some photos. Is there a way to tell if it has tile underneath? And I'm not sure the best way to remove it since it looks like it was sealed with grout around the edges? Thank you!