Why makes feather headdresses off-limits for cultural appropriation?

The list goes on and on for things we (Western Civ?) appropriates into our subcultures and mainstream.

But wear a feather headdress to a festival and everyone loses their minds!

What gives? They look really cool so why can't we just wear them and not inadvertently besmirch the whatever-they're-original-purpose-was?