Plot hole I found

Ok so we all know how there’s old people like Ivor and Hadrian in s1. What I would like to know is how that would work if in s2, the townspeople in Fred’s Keep remember Fred and what it was like when they could see the sun. Like how does time work down there? Does time just stop or is everyone like really old?