How to breakup with someone you care for

Become a care giver and I worry that breaking up will make things even worse for them but I know that staying will keep making things worse for me.