What would happen if during Kamino after saving League AFO simply left instead of continuing fighting All Might?

"Aight. Imma head out too" villain said begrudgingly and walked into swirling portal. Darkness swallowed him whole.

How story would go from there? I welcome long-winded thoughtful answers.