Amazon web data extraction and cleaning in VB, Excel
Project ID:
558514
Project Type:
Fixed
Budget:
$30-$250 USD
Project Description:
Hello,
I am using Excel 2007 to write Visual Basic programs (recording and changing Macros in Excel) for extracting and cleaning data from Amazon.com. The first task I would like to accomplish is to be able to dynamically extract all information on top 100 electronics products (including rank, prices, product characteristics, reviews, etc.) I need a consultant who is experienced in web scraping and could help me complete the task. I would prefer to use VB, but if it is much easier to do in VB.NET or some other way, I could learn. This is for academic purposes: mostly, for helping my students with their empirical work (they usually do manual data collection, which is a waste of time).
In the future, it would be great to have an easily adjustable web crawler to dynamically extract, reorganize, and clean online data from price comparison sites. Other web sites I would like to be able to collect data from are Shopper.com and Google Products.
I wrote a few programs by recording Macros, but it takes a lot of time to complete the whole thing and I am still to deal with some complications. I would be happy to provide you with what I have so far.
Thank you,
Maria
Skills required:
.NET,
Excel,
Visual Basic,
Web Scraping
Public Clarification Board
0 messages