New years in Reykjavik

Hey everyone!
We’re a couple in our early 30s visiting Iceland for the first time and we’ll be in Reykjavik for New Year’s Eve. We’re trying to figure out what’s worth doing that night.
Has anyone here done the New Year’s Eve Boat Cruise? Is it worth it, or are we better off just celebrating somewhere in the city?
Couldn’t really find much about the cruise specifically, so I’d love to hear from anyone who’s done it. Also very open to any other NYE recommendations in Reykjavik!
Thanks!