Applying a theme across all webpages

By themes, I am talking about stuff like the navigation bar and header; things I want to be the same across all my webpages. To do this, do I have to copy everything over for every webpage I want to create, or is there a better way?
Thanks.