Goal area violation after stepping out again

I know that as an attacking player if you're within the 6m (like after a fast-break) and then step out again to recover the ball, it still counts as a violation and your team loses the ball because you are coming out of the goal area. But how long does that last? Does someone else need to touch the ball inbetween? Does a specific amount of time have to pass?