Obsession with "realistic" geography

It seems like a big chunk of worldbuilders think it's really important for their worlds to be constructed with tectonic plates, wind patterns etc. in mind to the point where they criticise others for having worlds that don't follow these rules.

When did this start and why? When interacting with media, wether it be books, games, movies etc. I've never thought about if the placement of mountains makes geological sense, it doesn't even cross my mind.

Tolkien, arguably the greatest and most influential world builder of all time, explained all his geographic features through the working of gods or not at all. In fact tectonic plates were not even a popular idea during his time. He didn't put much thought into the placement of biomes or wind patterns either and I don't think anyone thinks of his works as lesser because of that.