Perfume and Food Allergies

I am allergic to citrus foods and tree nuts. Common ingredients in perfumes and other body products. Either the are directly scented with citrus oils, or nut oils. Otherwise the citrus is hidden in Limonene, citral, and other similar things. Now it's important to note that as far as I am aware, I am only allergic if I eat the item, though some of my old body scrubs that were orange or lemon scented did irritate my skin. I do touch my face a lot and therefore worry about the risks of these products making their way into my mouth somehow. Has anyone who has these allergies safetly used perfumes that contain these ingredients or should they be avoided?