Focusing on one stroke only?

Maybe I'm just bad at googling but i found nothing helpful about this topic.

I'm 22 and i just started swimming regularly. I plan on joining my local pools team, but i know that chances are bad I'll ever be able to compete with swimmers who've been training their whole lives...

so maybe focusing on one Stroke only - Breast - would give me kind of an edge?