Is there anyway to disable zoom in stock jelly bean browser? Not pinch.

I can't stand this. Every time I want to scroll down a page, it will zoom in. I know if I scroll in the middle it is fine, but my fingers are big and I keep accidentally zooming.