If I Get a Dining Job but then Withdraw Before the Next Semester Begins, Would That Affect Getting a Dining Job in the Future?

I'm wondering because I'm choosing between two jobs, I applied to dining in case I don't get the other one, but if I get accepted for the other job and I withdraw for the dining job I already got and passed the interview, would that hurt future chances of working a dining job?