HELP!! Lazy staff making me move departments

I have been with Tesco's about 8 years. I know well enough there's people that do nothing all shift and people that are flat out working, I have always thought that being flat out all shift makes it go faster and I like my back stock/delivery to be empty somehow I find it satisfying. However in the last 6 months we took on a member of staff that works on my aisle the days I'm not in. He does bare minimum for example 2 cages in a 6 hour shift. So when I return to work on a Monday the back stock has exploded it's not organised and I often get left around 12-15 cages after only a few days off. It's obviously he literally just leaves everything for me to sort and just wonders around all shift. I've spoke to my shift leaders.. they don't care. I spoke to my manager who said " we don't have many talented staff " so he doesn't know what I want him to say or do. I'm debating just going to my store manager and asking to change departments HOWEVER I like the aisle I like the job and I don't see why I should go because of his laziness... But I can't take anymore it makes me angry and frustrated makes me not want to even try and just do nothing all shift. HELP