Would this be considered vandalism?

Please look back to my previous post regarding the council-erected sign across the road from my house.

The sign seems to be simply pushed into the earth. Would it be considered vandalism if someone just jimmied it out of the ground and moved it? No damage done so how could this be classed as criminal damage by the way?