Data Scrape - csv file manipulation

• Project ID:

  555745

• Project Type:

  Fixed

• Budget:

  $30-$250 USD
  

Project Description:

Run data-scraping program 50 times (50 U.S. States) (program is provided)

Modify the resulting csv file (maybe with excel...) to take out columns
(save both the original file and the modifiied file)

Verify all data was scrapped

zip up csv files and email to me (email them as they are complete - one original and the modified file)

Will be more of this sort of work - and at some point, quite a bit...

----------------------------------------------------------------------------
Scrape Program Installation and Usage Instructions
Installation
* Download the attachment
* Unzip the compressed file using WinRaR (you can get it from http://www.rarlab.com)
* Please make sure that you have .NET Framework 2.0 installed ( you can get it from here)
* Double Click the *.msi file and follow the installation wizard


Usage
* Go to Start Menu -> All Programs -> Pasreo Scraper
* Click "Pasreo Scraper" (with orange icon)
* A black console and a desktop application will start
* Press "Start IE" and wait until IE loads
* Go to: <website and instructions will be provided to awarded>
* from the browser, select the state and all your search criteria and click "Search"

* if a CAPTCHA page shows up, enter the CAPTCHA correctly and press "Submit and Continue"
* The real estates page will show up
* now open the black console application and press "Enter"
* the application will start initializing its components and shortly it will start to navigate each and every real estate
* the black console will always show you the status of the scraping
* sometimes the scraper will be interrupted by a captcha page -again- (the scraper will wait until you enter the CAPTCHA)
* from IE enter the captcha and press "Submit and Continue"
* make sure that the real estate page is reloaded again (CAPTCHA bypassed)
* open the black console and press "Enter"
* the scraper will continue its job
* after the scraper will finish the job, it will notify you with the folder name (time stamp)
* Go to Start Menu -> All Programs -> Pasreo Scraper
* click "Pasreo Scraper Folder"
* you'll find a folder created with the previous mentioned name
* the folder will contain all the images and CSV file (with the fields you specified)

Skills required:

.NET, Data Processing, Excel, Web Scraping, Web Search