Wireless adapter and erratic packet loss

I am using one of the usb wireless adapter to connect internet. Modem router is located 1 room next to my computer. I have near perfect experience while downloading but can't say the same for gaming. I always have a laggy online game experience whatever game it is. Max download speed is 100Mbps in my subscription. What could be the cause of that?