Help with torque shaft adjustment

1995 XJ with an NP231. Wasn't wanting to go into 4wd so I figured the shaft bolt was loose. Tightened it maybe a full turn. Now 4Qwd works but as soon as I get on it it pops itself from 2wd to 4wd. Can anyone help me understand why this is happening and a possible solution?