Lateral moves

I went to talk to my career planner about lat moving to 0311 but told me that the 03 field isn’t accepting lat movers besides recon or marsoc, is this common for infantry to not be open to lat movers? I thought it would be a easy process to lat move into infantry considering Im pretty sure the retention rate is extremely low and need people to fill the gaps but clearly my dumbass was wrong and I guess I’m fucked from being able to experience the infantry