ELI5: What is the point of a closed primary?

A closed primary is a type of primary election used to choose candidates who will run in the general election. In a closed primary, only voters registered for the party which is holding the primary may vote. Why not allow every one to vote? What is the point of having a "closed primary"?