Download speed with Transmission shoots up really high, then drops to 0.

Has anyone else experienced this? This is with perfectly healthy torrents with many seeders. Normally would expect a high download speed, which happens in the beginning, but then intermittently drops down to 0, before later going up again.

Is this a problem with Transmission? My ISP? So confused...