The Lag

So I have my own server that I jam on but sometimes when i running i get this almost lag like happening and I dont understand what is happening, and its not cause of my setup or network, my graphics are on high but ive got a setup that can run the game smoothly on max and ive gone to low but the lag continues regardless. Im connected to fast internet and still happens. Any reason for this ?