Island Sanctuary Infrastructure

So i recently got my island sanctuary.

i think I'm island lv 6 maybe? i have a granary and a workshop, plus the additional vacant plots.

should i fill those vacant plots with extra granaries/workshops, or are there other things i unlock later that can go there?