Cayo perico location

Why when traveling to cayo perico when head south Cayo perico should be in the Caribbean right? Then why do we travel south if the Caribbean is located east of the usa and san Andreas (which is the fictional version of California) is located far west And it's not like oir character just heads south till he's out of los santos then starts heading east cause pavel always says the moment we start running the velum to go to cayo perico "it's a long journey south but you're familiar by now" which indicates that cayo perico's location in the universe is actually south