So I can't play online because of framerate

Immediately on starting the game, for about 4 seconds, my framerate is really bad. After that, it is totally fine. However, as soon as I start a game while in online mode it will kick me during those 4 seconds.

Is there any way around this?