Looking for places without kids

It seems like everywhere my husband and I go in Koh Samui has lots of families with kids. Where is childfree people hanging out on this island?