Where are the Dwarfs?

So I got the new Skyrim for Christmas, the special edition, and have hence played it quite a bit. I know there any Dwarfs in the game... but why not? I'm not too familiar with the storyline, but I know there's a bunch of Dwemer ruins, and they remind me of dwarven ruins like in the Lord of the Rings.... so how come there isn't some sort of Dwarf race?