Ideology - Relic Quests

So a quest for my colony's relic just came up and it asked for 44 colonists to take the stronghold, but if I do so my base is pretty much gone if a raid comes with so little defenders, will the quest fail if I don't meet the amount of people and just send a few combat pawns? I'm in commitment mode so I won't be loading saves.