Patio Polymeric Sand on a Retaining Wall

Hey folks! I am getting close to finishing a retaining wall which will have a patio added to the top. My question is: if polymeric sand is used to mostly seal the patio, that will mess with my drainage below correct? It’s backfilled with 3/4 washed stone and will have a layer of concrete sand between the stone and the pavers, all leading to French drains. It feels weird to focus so heavily on drainage for the retaining wall and then essentially create a water proof slab on top. Would filling with stone dust between the pavers make the most sense? Thanks in advance.