LPT, or how I felt like an idiot.

You can replace old stuff like belts and furnaces with their upgraded equivalents without removing them. You can simply place them on top of them...

I just found out. After rebelting my whole factory from yellows to reds...