Can I go beyond an area with a quest item and do the quest still?

Basically I am doing me stone quest, I need to go to The Caves, if I go to throbbing domain will I finish the quest still or do I need to get out on The Caves?