Which one to do first economy upgrade or military creation

Whenever I play first I improve economy upgrades and create military in castle and imperial age so I fell for 2 or 34 enemy combined and if I create military units I can't get enough resources to continuously create units. So I fell easily. What to do escape this?