When shipping a package does the post office charge by the weight and dimension only?

It occured to me that every time I take a package to the post office they don't really bother to look at the address where it's going. I guess I assumed I would get charged based on the distance a package is going, but maybe not? Are we charged solely based on weight and dimension?