[Meta] Help me get my schedule scraper working for the subreddit again

Hi guys,

I wrote a script a while ago to update the sidebar each day by scraping https://www.ussoccer.com/schedule-tickets and pulling the 4 upcoming matches for senior MNT, U-23, U20, senior WNT, U-23, and U-20 matches. The code can be found here.

US Soccer "recently" changed their website to be some weird HTML/CSS thing that is not easily scrapable.

Does anybody want to take a shot at trying to fix the Python code to correctly scrape the website? I had been using beautifulsoup4 and requests before. I know other users have posted Google Calendars that are kept up to date, but I would rather get info from the US Soccer website directly

Posted Oct 4, 2019, 6:02 PM UTC

83
wayment_•

I think I could probably get the information for all the matches and put it in a pandas dataframe, would that help, could you use that?

1
RedRavensOP•

Yeah that would probably help a lot! I've got it set up on a Raspberry Pi so I could host the script to make the dataframe too

1
Horncats7-59•

Don't know much about pandas but I've written scrapers in c# and java using their soup libraries so I'd be happy to take a look

1