Is it better to take pallets or play around them?

Obviously theres some nuance like super weak pallets or god pallets, but should I play around them more or just force the survivor to drop them and kick them asap?