Why does Dante never seem to keep his weapons?

In terms of game design i'm sure its cuz the devs want to keep your arsenal simple at the start of each game while also creating variety between each game and prevent your arsenal from getting too big. But is there any canon reason Dante always seems to just throw them out besides of course Rebellion, Ebony and Ivory and Coyote-A (i think)?