[P] LSTM Lookback Issues

I'm having a little bit of trouble understanding how to set up LSTM properly.

In particular I'm confused on its ability to carry information to future iterations - how does one set how long it carries information (i.e. when it forgets?). If I'm using time-series data and I only want it to carry information as far as the last five samples, how would that be done?