Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Is it going away?


AIUI changes to reddit's API have made Pushshift unsustainable.

Edit:

see here for the full details, from the reddit admins' POV: https://old.reddit.com/r/modnews/comments/134tjpe/reddit_dat...


Those changes haven't been put into effect yet, though. It's "coming".


nuts, I have a little app that relies on it. It is still working atm and returning results from a few seconds ago but that sucks.

I was also always baffled how pushshift API is so superior to the Reddit API. AFAIK it is running for ~$1k/mo.

Locking down APIs like this could lead to way more scrapers which is expensive for everyone involved. I guess the number of people who know how to hit an API endpoint is way higher than the number who can setup a Selenium type scraper that runs JS and circumvents protections.



Yes, it is no longer available from pushshift (presumably due to pressure from Reddit.) The historical data is now only available via torrent.


Link?


The torrent is the submitted link for this post.




Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: