I am posting a similar request that I found previously.
I would like to scrape the data from the following websites every 5 minutes. Some have an XML feed and some just have live lines on their site without having to login.
I need the event name, date, time the game starts, rotation number, what teams are involved (and which is home/away), type of bet, odds. I'm a little familiar with XML and could work with that, but it doesn't seem like all the sites have a XML feed and I don't know how to scrape the data from those places. I also don't know how reliable XML feeds are. I would prefer that you scrape the tables, some sites might require you to log in. Eventually I plan on comparing the odds that are scraped from each site so that I can see which odds are the best.
Also, I'd like for it to check if the line changed. If it did add the new entry to the database with the time it checked, if not then don't bother to add it.
Some of the sites I want to get data from are:
[url removed, login to view] / [url removed, login to view] / [url removed, login to view] / [url removed, login to view] / [url removed, login to view] / [url removed, login to view] / [url removed, login to view] / and maybe others, we can talk about this.
I just want to add, that the programming language used should be something that I can easily grasp and make edits as I may need. So something like PHP, python, etc would be best. I know some coding so this is flexible as well. Please let me know which language you plan on using