Why didn't they attack families of UA students?

Shigaraki clearly despised midoriya and later bakugo, killing his mother would be the most logical thing no? It would break deku for sure.