Starting on something small

For someone who knows nothing about pcs , what would be the better option in terms of getting your first pc should i start on something small like a £800 ($1000 USD) and then just do upgrades in the future or is better to just wait and save up and get a pc that can run and perform better . this is typically for comp games , if anyone can help me out it would be much appreciated . Thank you !