r/scrapy

2.6K archived posts · Mar 2015 – Sep 2026

Scrapy: An open source web scraping framework for Python

r/scrapy

Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

Created Mar 11, 2014

6.7KMembers (last snapshot)

2.6KArchived posts

Scrapy

Scrapy is a powerful open source web scraping & crawling framework for Python.

Community

Resources

Guidelines

The Scrapy Community Code of Conduct applies for any kind of interaction made through this subreddit.

In summary:

Be respectful with everyone.
Do not post NSFW content here.
Do not troll, insult or harass anyone.

And last (but not least) please follow reddiquette.

FAQ

Can I ask troubleshooting questions here?

Yes. But StackOverflow is better suited.

Can I share my Scrapy articles here?

Please do! :-)

Can I share my Scrapy projects here?

Yeah, definitely.

Can I ask for advice on my projects here?

Yes, this is the perfect place for that.

Can I promote my company here?

Please avoid it. ;-)

Other communities

Reddit Rebuilt is an independent, non-commercial archive and is not affiliated with Reddit, Inc. Content belongs to its original authors.