What should I do if my neighbor is threatening to sue me over a fence dispute?

I'm currently in a situation with my neighbor regarding a boundary fence. We had a disagreement about its location, and I had a surveyor assess the property line, which confirmed that the fence is on my side. Despite this, my neighbor is claiming that I encroached on their property and has threatened legal action if I don't move the fence. I'm feeling overwhelmed and unsure of how to respond. I know that I have legal rights regarding my property, but I'm also concerned about escalating the situation. I want to handle this professionally and avoid any unnecessary conflict. What steps should I take to protect myself? Should I consider seeking legal advice, or is there a way to resolve this amicably? Any insights or similar experiences would be appreciated.