What to consider when determining visa type?

I've gotten a contract for a company in Japan, and my start date is tentatively set as well. We're starting the process for my COE, and I'll qualify for either the ESI or HSP visa. I've been going back and forth on which one to ask the immigration attorney to put forward for me, and my wife is also up in the air on which one we should go with. We know the advantages and disadvantages that each visa type comes with, but we're really unsure as to which we should ask for. What considerations and questions did folks use to help determine which visa to apply for when moving? Just wanting to get some input from others who have gone through the process and maybe find some questions we haven't thought through yet.