Landlord showing up with no warning

After a year of no communication from my landlord today he showed up at my door with no warning or notice. I emailed him a few weeks back regarding fencing falling due to a storm he did not respond. I was in the middle of changing my disabled child. I managed to get her half dress and I answered the door. There he was, I asked if we could arrange a time probably due to me being busy caring for my child. He said he needs to come through to the back to see what tools he will need to fix it.. I felt like I had no choice. He came through. When he got to the back door I explained it’s locked as my daughter will and can get out. My door key was on my partners car keys who was at work. While he was inside he not very sneakily looking at everything and the downstairs room. My child was distraught as she does not like unfamiliar people. He left and went around the back and jumped over my back fence. I’m sorry but am I being unreasonable here or is this soo unacceptable?