Frets are super shiny, but still scratchy

All the guitars I polish my frets on end up super shiny yet still feel scratchy. What am I doing wrong? I am wiping them clean until there is no residue left on the cloth I am wiping it with, so there's no metal residue in the frets. I just used 3m polishing papers and finish with some fret polish, and the frets are a lot shinier than when I started, and yet they feel scratchy. My PRS that I've never messed with has quite full frets and yet they are very smooth feeling. All 4 guitars that ice polished frets on have this issue. I don't get it