Should I wait for a GPU?

I'm building my first pc and will have all the components except for the gpu. Is it worth hooking it all up and booting, then installing the programs I want? Would there be any issue in sticking the gpu in later? I mean, I know it would work, but will I need to mess around with drivers or some other things I don't know much about? Basically, will it crate a bit of a hassle for me when I do get the gpu?