If you were on a deserted island for years with no human contact, would you forget your primary spoken language?

Say Tom Hanks really did crash on that island, but spent not just years, but decades. With no one to have two way communication with, would he forget standard English? Would his vocabulary shrink? Change? Would words lose their meaning without use?