L3 survey on a 1900s house - please talk me off the ledge in either direction

We're first time buyers in our 40s, this is a 4 bed house in a conservation area. We saw this place 2 years ago, the dining room floor was already going then. Now, it's bowed so much that the vinyl flooring has torn. Their idea of fixing damp was injecting half the downstairs and dropping in a solid concrete floor a few years back.

The survey is a wall of Condition Rating 3s, and while the surveyor used the usual "reasonable proposition" line, he also told us straight that the house is in a worse state than average for what he sees locally. The heavy hitters:

• Chimneys (x3): cracked flaunching, spalling, bad roof junctions. One is totally sealed which may be contributing to the damp in the room with the bowed floor.
• Roof: slipped tiles, cracked ridge tiles heavy moss, large leadwork area "repaired" with Flashband tape so long ago that its disintegrated. Flat roof needs renewing soon.
• Gutters: twisted, leaking/blocked, feeding the damp below.
• Damp + floors: the one keeping me up: known damp history, mystery slab, all bar 1 air brick has been blocked up with render (problematic as the conservation scheme requires approval to work on the render) high moisture inside including in the rooms they had damp treated.

So: most of it is "water gets in" + lack of maintenance. But between two years of watching it rot and the surveyor flat-out saying it's below the local norm, I can't tell if this is the renovation project I knew I was signing up for, or a red flag.

Houses hardly ever come up in the area we want to buy and we budgeted some money to make it right when we offered but this is beyond what I was expecting. I am dreading running out of money mid repairs.