Internship is supposed to be in person, but the team works remotely?

This summer I'll be working as a software engineering intern. The position was said to be in-person, and I have a designated office location in Jersey City, but the team I'm assigned to apparently works remotely. After talking with my manager, he said that his team is spread throughout the country, and he himself is located in New Jersey, but not in Jersey City. He mentioned that he could occasionally travel to the Jersey City location, but otherwise no one on my team is going to be in the office location that I am assigned to.

I'm pretty disappointed because I thought it was going to be a complete in person experience going by the earlier communication from the company. I really want to experience what it's like to live in Jersey City/New York Metro, but I'm not sure if it's worth it considering that I've now learned that the internship is basically virtual.

Is it still worth moving to Jersey City for the experience? Or should I maybe contact my recruiter to see if I can be reassigned to a completely in person team?