Is it wrong to cut off toxic family members if they’re not physically abusive?

I’ve been debating cutting ties with a family member who constantly criticizes me, manipulates situations, and invalidates my feelings. Some people say family is family, but I don’t know where the line is. I could use honest opinions on where you’d draw the boundary.