What do you think is the max amount of cats to own?

As a cat owner of 4, I've always wondered how many is too many. All over current movie/ tv media, you see depictions of people owning 20+ cats. So my questions are: When does it become unethical/animal abuse? Is there anything legally restricting you from owning that many cats? If not, should there be?