Source
r/DataHoarder•
prograc

Gamespot TXT GameFAQs - Full Archive (3/23/20)

Hello all,

About a week ago, I came across this post asking for a way to download the Gamespot FAQs. Spent some quarantine time getting it all together for everyone here. I've gathered and organized according to Gamespot's system generations. Unfortunately, I was unable to parse any FAQ that is html based, rather than text based, to my satisfaction. To that end, I've included a text file with links to all HTML based guides on the Gamefaq website. Hopefully with the included text file, another intrepid (and better) scripter can scrape those HTML faqs in a decent format.

Notes: I started scraping around 3/23/20 so the archives should be current up thru that date.

Example

Links:

Gen-1

Gen-2

Gen-3

Gen-4

Gen-5

Gen-6

Gen-7

Gen-8

Gen-9

TORRENT FILE

Hopefully, this is enjoyed by someone out there (/u/anakinwasasaint, u/atown162, u/forthedatahorde)

Posted Apr 2, 2020, 7:07 PM UTC · edited

1616
Bobby_Marks2•

Awesome! I've been working on this for months now, and it's been a headache.

EDIT: It seems gen 8 is about one-tenth the size of surrounding generation files. Is there a reason for that?

6
progracOP•

It's basically a dead generation. If you look it only includes: 3DS, Amazon Fire TV, Ouya, PlayStation Vita, Wii U, and Windows Mobile. Nothing there even begins to compare to the juggernauts like X360, PS3, Wii (7th Gen) or PC (9th Gen). That's the reason for the size discrepancy. Just not a lot of FAQ content.

5
Bobby_Marks2•

Okay that's good then.

5
anakinwasasaint•

This is incredible, I don't think a rom set can be considered complete or even useful in many cases without these. Sure they're likely to be available on the internet but that's subject to change. I think we're all here to hoard useful data and I can't imagine anything being more useful per MB than txt based game guides.

​

Thanks!

5
progracOP•

Glad to hear it. Thanks man! I hope the thread gains some traction so everyone can see it.

2
takyawn•

Damn, good job! I hope this post gets some attention like the one where people were trying to figure it out.

2
progracOP•

Thanks man! Hopefully people find it (ha!) and then find it helpful.

2
takyawn•

You should try crossposting this to r/DHExchange :)

1
progracOP•

Done. Good idea.

2
kristoferen114TB•

Many thanks

2
8VBQ-Y5AG-8XU9-567UM•

Why didn't you create a torrent instead?

1
progracOP•

Can do. Give me a minute.

EDIT: Attached to the main post now.

5
8VBQ-Y5AG-8XU9-567UM•

Thank you, I'll seed for now if any issues aren't discovered.

Hash: 589D0BBF445BD52A15DD9DB6B2A71D06634A4419

2
progracOP•

No problem. I've got it in my seedbox as well.

1
8VBQ-Y5AG-8XU9-567UM•

Have you considered informing r/Archiveteam or u/-Archivist about this?

2
lantern48•

Holy Shit! This is awesome. Thank you.

1
progracOP•

No problem. Glad I could help

1
elfelf85•

Very cool! Been looking for something like that for awhile now! Many thanks for this!!

BTW, are you open to sharing your scraper code? Was thinking if it could be improved further to get the difference between the last time and the current time, and download updates for that archive. A little like how youtube-dl does their archival method.

1
progracOP•

Unfortunately, I don't have it anymore. Kinda kicking myself for not keeping the scripts but I never thought it was anything special. Basic flow was wget -> sed -> batch renaming. nothing terribly automated or any kind of all in one program. Did it all in terminal with a fair amount of manual hand-holding. Could be done in cygwin too if you're on windows.

1
elfelf85•

That's mighty load of work using wget and sed.

Thanks for sharing anyway! :)

1