Our company has an ongoing project that has to do with online sports predictions.
We have a data provider. It proved lacking in some data, and this affects the quality of data we want to provide our clientele; thus, we need to get our hands on more relevant data. We need someone who has a solid experience in web scraping. We are pretty clear on what we want to achieve, where to get and what data we need exactly, but we have hit a snag with our steps, and we need someone to help us. In a nutshell, this job will entail:
1. Setting up a process of pulling data from 2 websites or more using a scraping tool like Octoparse;
2. Putting the data pulled/ output into our database because we need to have that eventually put into the API we are building;
3. Doing the data pulling as a scheduled scraping (websites to be scraped: - OddsPortal and Footystats);
4. Working out inconsistencies (for example, data IDs that vary from one website to another) of the data pulled from different sources into a coherent and organized whole on our database.
This is basically our plan of action but there must be a much better or easier way and we need someone to help us. To give you an idea, we need to scrape these data:
From Footystats / Whoscored / Flashscore (website sources)
- Leagues / Historical Season Matches / Historical Season Stats
- Teams / Historical Season Stats
- Players / Historical Season Stats
- Historical Odds with Bookmaker
- Future Odds (Scheduled Scraping) with Bookmaker
Please, no timewasters as we have interviewed some candidates before who let us down. So if you think this task/job is something you have done before or you can easily do, please express your seriousness by sending us your CV, a short message about any experience you had about scraping, and how that relates to this job we have posted, and answer this question: When you did that web scraping task/job and you experienced being blocked because of your IP, how did you get around it to finish the job?
44 freelancers are bidding on average €2113 for this job
hello. i can build your project with my professional skills in Data Mining, MySQL, PHP, Software Architecture, Web Scraping. you will get full satisfy. we can discuss more via chatting. best regards.
Hi there, I can help you with scraping and building API. I have a lots of experience in this field. Please ping me back so we can discuss further. Looking forward to hearing from you soon. Regards, Pooja Bohra