Game freezing on exit

My game freezes when I exit to main menu, basically I can hear the main menu music but the game remains frozen on the world and I get error in console saying "IndexOutOfRangeException" in red, I also get this when I start the game but it doesn't freeze.

I tried removing different mods but it didn't work, I am not sure if it is a vanilla bug or something else, anyone else had the same problem?