Question about the manor

Can we leave the manor to explore a city and then still return to the manor? I don't really wanna use all of the spooky adventures at the beginning of the month. Thank you! 🖤