Can we tear down a fence in our property

A land surveyor came to our house last week and we found out our property goes multiple yards past the fence into our neighbor’s yard. Can we tear down the fence or does our landlord need to go to court?