How does Hollister fit?

I usually wear a mens medium but want baggy hoodies, sweatshirts, and sweatpants. Should i size up and get a large or no? Im 5'8 and the models being much taller than me always wear Mediums and its throwing me off to see what i should get. My gap size is large for baggy if that helps