Scraping script to extract from website & then load my site
$30-250 USD
Cancelled
Posted over 14 years ago
$30-250 USD
Paid on delivery
Scraping script to extract from website and then load into our website.
Bidders must answer the following 2 questions
[login to view URL] experience in developing a spider, extracting data, transforming data and then loading into new website
[login to view URL] technology that will be used to perform the scraping and the format the data will be saved in.
Deliverables
Spider and scraping tool.
XXXXXXXXXXXXXX
An application that will spider specific website and extract content that follows specific 5 business rules. The data should be extracted and presented in a readable format such as excel for us to review, adjust. An additional column should be added that will check that all mandatory data was found and set the flag to complete record. There should be multiple extract files based on each category (12).
Load tool
XXXXXXXXXXXXXX
A load tool that will take the extracted format from scraping and post to our web form to insert new data. This tool should be able to run multiple times and handle errors such as record already exists or report success or errors.
Thanks,
SOAmods