How does Yuji know "Sukuna is plotting something with Fushiguro"

Is there something I missed or forgot about in season 2? There seems to be no reason for Itadori to assume this