r/sre•
livebeta

what happened to Reddit?

2+ hour site outage globally. any clues?

Posted Mar 15, 2023, 1:49 AM UTC

3721
WeAllThrowBricks•

Better than Datadog at least...

37
jimogios•

did they offer any compensation?

5
WeAllThrowBricks•

That's on my manager.

2
lumi_narie•
6
razzledazzled•

It’s a shame there’s no professionalism in the updates, just “talking to you like a baby idiot” nonsense

11
lumi_narie•

Not all updates can be shared and it depends on the company culture as well. I've seen companies even outright refuse to accept that there was a downtime for multiple hourse when it starts. Reddit was at least pretty quick to update that (within 30 minutes from what i know)

9
rnmkrmn•

Or us-east-1

12
namenotpicked•

God I hate us-east-1

4
razzledazzled•

Yeah some companies are shit, some are good. This is a shit update

5
lungdart•

Reddit used to pride itself on its openness.

Any small issue usually resulted in a highly technical blog post a few days later. Haven't seen one in years though...

4
KJKingJ•

It's not quite an outage report, but there are some interesting technical posts on r/RedditEng.

2
KJKingJ•
1
MundaneFinish•

For a person named razzledazed you sure seemed razzled without the dazzle.

Try not to take things so seriously. Also RCAs take a few minutes. Go have a bananer.

1†
tcpWalker•

Reddit is still very much working on improving reliability. I hear they've also swung too far in the process direction internally in response to some breaks, so the pendulum has to swing back a bit toward rapid iteration as they improve. Lots to do and some good people working on it.

3
hawtdawtz•

Meanwhile they have had the same SRE job listing posted and won’t hire for it

2
gerd50501•

it was down a lot longer than 2 hours.

1