Proof there is a distinction between Cro-Magnon and Neanderthal's?

People who try to dispute a difference in species will use the argument, how can scientists say that Neanderthal remains really aren't just that of a bigger Cro-Magnon? How do I prove that this argument is complete rubbish?