APU vs GPU

I have an A6-5400k APU and an old Raedon HD 4300/4500 series

The APU gives better performance but I can't use dual moniters without the GPU and the dual moniters are fairly important, is there any solutions? Even just a way to quickly disable the GPU for if I want to do somthing that requires more performance.