Not a SO but husband is. Can we garden?

This is going to seem so anxiety riddled. My husband and I are moving in with a family member who is super into gardening we totally are too. It's a super great family activity. This family member has a garden in the front and back yard which we've only ever done backyard gardening. Our worry is that the neighborhood this family member lives in tends to be extra cautious and of course we aren't trying to disturb anyone just raise our kids. I generally do everything with our kids so this would be the first time that any neighbors really see us out as a whole family unit.

Do we go out to garden? Maybe I'm being overly cautious we just want to stay out trouble and not bother anyone.