How dangerous is it to drive a car in which one of the tires is missing 1 or 2 out of the 5 lug nuts

I, as someone who has never worked on his own car before, decided to change my brakes and rotors..after running into multiple road blocks with the project (couldn't get the bolts loosened, and had a hell of a time getting the old rusty rotors off) I finally got the rotors off, got the new pads installed, calipers back in place..now, what I think Is my final roadblock. When I was trying to knock the rotors loose I unintentionally hit a couple of the bolts that the lug nuts should later screw onto. Doing this it pushed those bolts in a bit, and loosened them up..now when trying to put the wheel back on, one of those bolts is pushed in too much for the bolt to come through the wheel and I can't get 2 of my lug nuts on because of it