Dark brotherhood and crusdaors relics.

I want to wear the relics as it took me ages to get them but I just got a notification after completing a darkbeother hood quest not to continue down this path or I’ll be unfit to wear the armour.

Is there any way around this? I really like the dark brotherhood quests.