Old Injury Making Me Freak Out

So I'm roughly 4w5d-5w pregnant with my first after multiple failed IUIs and one chemical pregnancy. I've been feeling twingy since the beginning, but no bleeding. The one thing that worries me is that about 2.5 months ago, I fractured my collarbone and sprained my shoulder tip. So guess what's hurting constantly now? That coupled with low initial betas (19 at my first, but more than doubling since-I think we were off about 2-3 days on ovulation) has me freaking out about ectopic pregnancy. My doctor isn't worried because my numbers are going up perfectly and my progestrone and estrogen are high, but I've heard of numbers doubling well with ectopic. It's too early for an ultrasound, but how much should I actually be freaking out?