Realistically speaking, wouldn't Sanji stop being a pervert since it's a character trait he shares with his brothers? You'd think he'd distance himself from anything that reminds him of them. He even dislikes the concept of having Conqueror's Haki because he doesn't want to be like his father