I'm trying to do the fist moon skip but I keep hitting the invisible wall

I go left of the wall where the chest is and I keep hitting the invisible wall