Do I remove the 1666MHz sticks in my pc to stop holding back my other ram sticks that are rated at 3200MHz

For context, my computer is a bit of a Frankenstein’s monster of random parts I’ve salvaged over the years, I have a ryzen 5 5600, an rx6750xt, and 24gb of ram, 16 of those are some 32MHz sticks I bought new back in 2021, and the other 8 are some 1666MHz sticks I salvaged from an older machine. my ram speed is stuck at 1666Mhz bc of the slowest ones, so would it be worth stepping it down to 16gb of ram to have it run at full speed?