Is it normal for sorcery in DS3 to hit you despite physically not even touching you?

I'm a fairly novice invader in any Souls game but I had this one invasion where the guy just ran and spammed soul darts, and I couldn't even touch him - his magic would deal damage despite literally shooting past me. If I didn't roll it would always deal damage. Is this just normal desync or something? And is there anything that can be done about it aside from "git gud"?