Why do people not opt out of escrow?

Just curious why majority of borrowers dont opt out of escrow. Is it because they they wont diligently save for their taxes and insurance?

You can look at your insurance and tax bill divi up by 12 and put the monthly amount in a high yield account to earn a few hundred bucks end of the year. Its not a lot but why give it to the bank?