Wow, thanks for that. Tried out After Effects and the ability to delete the tracking points was exactly what I needed. Thanks!

no, there is no way to change it, you will need to use something like after effects to get better results

So I am trying to apply a little bit of stabilization in Sony Vegas to remove a bit of camera shake. However, it has latched on to an object in the scene and zoomed way in on it, even when it is turned down to 0.01. Is there a way to force it to focus on stabilizing using the background instead of this object?

Set a different focus point for stabilization in Vegas?