Invincible invader?

Today I got my first invasion. I tried to attack the guy with my Butcher Knife but it didn't deal any damage. Instead the guy's ghost would vanish for a second. He could hurt me just fine, however. I ended up running back to the area's starting point and he was so annoyed that I kept running away that he just left.

Did he use a special item? What was up with that?