Should you be wiping between the door seal (gasket) and the drum of the washing machine or would that ruin it?

no one anywhere really specifies about this; just says to dry the door and seal after every wash

when I was drying it, one of my older family pointed out I can't be so "aggressive" by drying in the tiny spaces between the door seal and drum, or I'll ruin the seal

but idk, I feel it's important to get rid of as much moisture, so not risk mould

what do y'all think?