[Meta] Help me get my schedule scraper working for the subreddit again
Hi guys,
I wrote a script a while ago to update the sidebar each day by scraping https://www.ussoccer.com/schedule-tickets and pulling the 4 upcoming matches for senior MNT, U-23, U20, senior WNT, U-23, and U-20 matches. The code can be found here.
US Soccer "recently" changed their website to be some weird HTML/CSS thing that is not easily scrapable.
Does anybody want to take a shot at trying to fix the Python code to correctly scrape the website? I had been using beautifulsoup4 and requests before. I know other users have posted Google Calendars that are kept up to date, but I would rather get info from the US Soccer website directly
Posted Oct 4, 2019, 6:02 PM UTC
I think I could probably get the information for all the matches and put it in a pandas dataframe, would that help, could you use that?
Yeah that would probably help a lot! I've got it set up on a Raspberry Pi so I could host the script to make the dataframe too