Refinance new loan due or what…

I recently purchased a house and have 412,000 financed on new 30 year conventional loan. I sold another house and have like 200k in proceeds after spending all I need on the new place with funds saved for repairs. I also have an inherited Ira worth 280,000. Should I pay off the loan entirely, meaning take a big tax hit on withdrawing all from the inherited Ira or should I look to refinance to a 10 year loan (may have to wait 2 years) and just withdraw from the IRA over the course of the decade to cover the monthly mortgage?