Aerator screen substance

I have to periodically clean the aerator screens in my faucets as a gravel type substance will clog them. I understand this is a normal task. One faucet will clog with a brown gel type substance. What could this be and is it harmful? I'm in WI in US using city water whose source is a large lake.