How would an anarchist society protect itself from imperialism?

An anarchist society would not have much in the way of organized military defense, I would presume.