Download speeds suddenly dropping on Xbox One S

Hi there, I acknowledge this isn't the exactly the right community but the r/Xboxsupport subreddit hasn't been helpful yet.

I am having a problem where for the first like 10-20% of downloading something (Game, app, etc) on my Xbox is perfectly fine going around 200-300Mb/s then out of nowhere it drops to anywhere from a few kb/s to like a max of 10mb/s. It is not my network for I've already ran a speed test on multiple devices wired and unwired (Including the built in speed test on the Xbox) and they're all getting at least 500mb/s up and down. Is it possible it's my hard drive because I've had it for quite awhile now (5+ years) and I've had to reformat it like 6 months to a year ago? I also used to use that hard drive on a Xbox One if that might play into this.