What's the best material for sauna + cold plush sessions to where as shorts?

I don't want to wear standard swimming shorts because I wear the same shorts in the sauna, and want to avoid and plastics/synthetics. I've used some seersucker shorts that have been pretty good, and using AI I've seen that apparently hemp or linen is good for cold plunge too.

Does anyone have any recommendations?