can I refuse to work alone with a certain ssv?

There’s a ssv at my store that EVERY single partner hates. He’s honestly terrible at his job and has done many things that are fireable. I’ve talked to my manager and DM about him, and nothing has been done. Multiple complaints have been made and he still works here!! I’m scheduled to close with him for the next week and from 4pm-close it’s just the two of us. He is extremely unhelpful and rude and I honestly can’t take it anymore. I’m so burnt out and want to quit because of him. Is there a way I can just simply refuse to work with him? Or can I get fired for that?