r/SubredditAnalytics

1K archived posts · Jul 2014 – Mar 2016

Analyzing the relationships between subreddits

Using a bot to analyze 1000 users to sample related subreddits.

Created Jul 24, 2014 · restricted

59Members (last snapshot)

1KArchived posts

Each visualization illustrates the top 50 related subreddits for a given subreddit. A sample of 1000 contributors are used to generate a measure of the behavior across subreddits. How are they generated? Let's say that we are analyzing some hypothetical Subreddit A.

A Python bot requests Subreddit A's 1000 newest hot submissions.
From these requests, it generates a list of the 1000 most recent submission and comment authors.
The bot requests those 1000 authors' posting/comment histories.
- When an author contributes to another subreddit, say Subreddit B, a node for that subreddit is created. If that node already exists, its user count is increased.
- If the author contributes to a third subreddit, say Subreddit C, then a link is established (or strengthened) between Subreddits B and C.

The visualizations are generated on a Raspberry Pi server using PRAW, NetworkX, and graphed using D3.js. After each network is generated, the analyses are automatically uploaded. Each scrape takes a few hours hours due to Reddit's request limits.

======

Related subreddits:

r/SubredditAnalysis

Other communities

Reddit Rebuilt is an independent, non-commercial archive and is not affiliated with Reddit, Inc. Content belongs to its original authors.