Why are you supposed to be late to a party?

Simply what it says, why is showing up to a party on time such an issue? I am simply not someone who likes to be out super late, but my friends always make fun of me during the pregame because I want to get there on time.

I just don’t get why you would set a time for a party to expect people to come AFTER it?