Having issues with my photos

Example 1 In this photo there is a black dot. And I'm wondering if someone could tell me if its a dead pixel or not. This is not the only photo I've had this issue with.

Example 2, Example 3

So, as you can see the little black dot appears in all three photos. And checked to make sure it wasn't the lens because I switched out my 18-55mm to my 55 to 200mm. Both shots still had the black dot. And in this photo, Example 4 the blemish isn't as prominent. So I'm led to think that its in the body of the camera itself. Thing is I'm not sure how to go about cleaning it.

And yes, I do have a cleaning kit that came with the camera.

Any help is much appreciated!