Why do I have a good connection in every other game besides Destiny?

Every time I play PvP my connection will flash between yellow/red bar all game. I've played CoD this year always getting a 4 bar low ping connection, I can play Overwatch with no lag at all, but when I come back to Destiny my connection is just pure trash. Any ideas why or how I can fix it?