[S1 spoilers, future spoilers] I just realized something about the first episode that's very exciting for the future

In the first season, mostly the first episode, Oliver is really messed up. He's dirty, beaten, struggling to survive and can't sleep unless he's weirdly at his own window. What happened to him in between now and season 1?