Cushion filters look dirty

When the filters on the nasal cushions look dirty is it time to throw them away.?