So what's up with critical damage?

Weapons like the cursed sword and money ranged weapon deal only critical damage while deaths scythe's ghosts deal critical based on the ghosts hp iirc

How does it actually differ from regular damage aside from just being higher like is there some defense it ignores or scales better or what