Why do Relics even have colors?

Is there really any point to relics having colors other arbitrarily stopping you from making a good load out? Like, as far as I’ve notice and as much as I’ve read the color of a relic has zero baring on what effects a relic can have on.

No, “Only red relics can roll +physical attack damage”

No “only blue relics can roll +Mind”

So what’s the point of them? Other than making you go “ah damn. Those are amazing effects but that color makes it unusable for my loadout”