Sweep Picking Question

Ok, so to practice/improve my sweeping, I'm practicing this simple lick: e-12p8------8-| b------10-10--| g--------9----| d-------------| a-------------| e-------------| and the thing I've always wondered since I began sweeping, is how do I attack the note on the G string? Do I hit it on my way down or when I go back up?