Using the virtual desktop affects internet speeds?

I'm on wifi, but when I do a speed test with the headset on I get 1/5th of the download / upload speeds compared to when the helmet is off. Is this normal? Does it connect to the laptop over some p2p wifi? Do I just need a nearby wifi router?