I don't drink or do dr*gs, will this affect my social life at uni?

I know drinking and dr*g culture is a big thing at uni, at clubs and nights out but I don't want to participate in either of these. Will i struggle to find other sober people, im worried most of my flatmates will be drinkers and make me feel left out.