Changing settings breaks server connection

I'm trying to set up a self hosted, dedicated server. Initial setup works fine, people can connect, everything seems to work fine. However when I change anything in the settings ini file, the server suddenly stops allowing connections. Even without adding/removing anything and simply changing a value for stamina regen for example.

I'm using the community installer on a TrueNAS system.