Metadata for 2.6 million Pornhub videos spanning 320k playlists
I scraped metadata for 2.6M pornhub videos based on the 320k most recently updated playlists as of mid-July 2019. In total, the data is 350MB in compressed json form, separated into playlist, video, and matching/cross-referencing files. They're directly downloadable from these links:
https://datahub.io/racydata/final/r/dfp.json.gz (14MB)
https://datahub.io/racydata/final/r/dfv.json.gz (120MB)
https://datahub.io/racydata/final/r/dfm.json.gz (210MB)
And here's an example jupyter notebook that uses the matching data (40 million pairs of (videoid,playlistid)) to make a sparse matrix with dimensions of (number of unique videos x number of playlists) and reduce the dimensionality with SVD. Then you can get "recommendations" for playlists/videos similar to a particular playlist/video based on the distance in this reduced dimensional space.
https://gist.github.com/racydata/92ae85ea47da7c2d0bf50442bb0e83ea
The notebook also shows what columns you can play with in those three files.
Posted Jul 29, 2019, 4:54 PM UTC
for “research purposes”
There's something surreal about that notebook. It's a perfectly normal dataframe that you'd use at work every day until you see what's in "title"