Down?
It seems like pushshift(dot)io is down and has been for a couple of days? Do we know what's going on?
Posted May 4, 2022, 7:35 PM UTC
917
they've updated the rules around rate limits:
it looks like if you make too many calls, they bonk you on the head, and stick you in data-jail for 1h
2
That monitoring tool doesn't produce enough requests to be penalized... Pushshift does in fact seem down.
2
Plus I only checked it after having issues with the various search sites/tools connected to it so I think you're right
2
oh no! i thought i was being put in data jail. any luck?
2
Just tried one and it's still out, idk
2
Its still down
2
Any idea how to resolve
2
The problem is not your/my/someone's app, the server itself is down. There's no "how to resolve". We just have to wait patiently. Everyone should check their rate limit algorithms though as they are cracking down on those who do not respect it (1 hour ban).
5
Its working now
1
Sorry about that. I don't have the proper size switch currently and this replacement one has been overheating. I stuck a fan directly on it and have a larger switch coming in tomorrow as a better replacement. I was lucky to have a smaller switch the other day.
Should be up now -- I'll keep an eye on the temperature and hopefully it doesn't lock up. I would have gotten it resolved sooner but I was taking a nap at the time because the storm last night caused additional issue. Crazy 24 hours.
2
Hey don't be sorry, we're all super busy just surviving and that shit ain't cheap I'm sure. Thank you just for doing it, I appreciate this project as a service.
1
Back up now, bigger switch being installed.
1
Ty ty ty
2
Yes, it's been down for about 3 hours, and has been having sporadic issues for a couple of days.
u/shiruken do you know why the monitoring agent only sees the submissions endpoint as being down, even though the comments endpoint is down too?
Hmm I'm not sure. It's just checking this url and it hasn't seemed down for me yet
https://api.pushshift.io/reddit/search/comment/?size=0&metadata=true
I'm not sure either, but I'm fairly confident that it was down earlier, although it's back up now. Maybe change
sizeto 1?FWIW, I've been using a simple query like https://api.pushshift.io/reddit/comment/search/?size=1&sort=asc&fields=body&q=*&link_id=t4995r, though I don't claim that it's the best option.
Probably worth examining further when it's down again. I just copied the url that I was using for the submissions.