Why does deacon hate the Minutemen?

I was playing through and achieved maximum affinity with him so I know his story but I couldn't figure out his distaste for the Minutemen does anyone have any input or am I missing something?