Is it wrong to dig up the plants I’ve planted at my rental when we move?

For backstory; our rental is on my husband’s grandmother property. She has a quarter acre in the Bay Area, very beautiful Victorian estate with a carriage house in the back (where we live). It’s getting a bit tight, it’s My husband, two boys and myself AND we have another on the way… so we are definitely looking to move within a year. My husband landed a great job with great pay so when he gets 1 year under his belt we are going to apply for home loans again.

We have lived here going on three years now. This place was very unkempt and neglected. His grandmother works 50+ hours a week and tends to her husband who is bed ridden. My husband and I have done little by little trying to spruce the place up, and well, landscaping and gardening has been our big projects as of recent. I don’t know why but I have a connection to some of the plants I’ve planted here, and told my husband when we move, I’d like to take the plants that I want with us. He said not to, and that we can just get new ones but I seriously would be heart broken knowing she won’t be watering them when we leave, and they will just die i know it. Some of the plants are as old as my first born and idk I just have a connection to the garden, and flowers we’ve been accruing. AITA that I’d like to take my plants with me when we move?