Wall paint suddenly chalky

Hi,

I've just repainted my walls black with an eggshell finish however I have this problem that when you touch part of it suddenly after a day or two that part becomes chalky.

Does any one here know why and how to prevent it?

​

TY in advance.