Leaving mid year

Hi fellow school social workers! It is my second year as a school social worker- I am really struggling and the year just began. I work at a special education school, I haven’t liked it since I started but I want two years of experience before trying for a district position. I’m not sure I can make it the tough the year. Is it true if we quit mid year it’s a career ender for school settings?