ELI5: Why do bad smells linger on skin but good smells disappear instantly?

I swear I only touched the fish for a minute. Washed my hands. Sniffed them. Smelled lemony. Then a few seconds later, straight fish on fingers. This happens when Im cutting onion or garlic too. Happens to my hair too. Its driving me insane. But let it be perfume and poof.