Why do people constantly pick Prince as Michael Jackson's biggest rival, when it was clearly Madonna?

I like Prince, but even in his prime he couldn't reach the heights Madonna did. She was always battling Michael Jackson for the number 1 spot on the charts, not Prince. I hate to say it but I think people compare Prince to Michael Jackson because they looked similar.