How can the universe be infinite?

Presumably, at the beginning of time, the singularity before the big bang had only a finite amount of energy stored inside of it. How, then, can the universe be infinite with only a finite amount of beginning resources?

(Note: I'm no scientist, so my premise might be a bit off.)