Can you make a hydrogen atom from one electron and one proton?

If I have an electron in one hand and a proton in the other, how can I combine them and get the electron to orbit the proton (in other words make a hydrogen atom)? How can I prevent a proton-electron collision, which I believe produces a neutron and a neutrino? Is this possible, and if not where did all the hydrogen in the universe come from?