Completed

Web Scraping with Screen-Scraper Software

This project was successfully completed by rhkchathuranga for $90 USD in 2 days.

Get free quotes for a project like this
Employer working
Completed by:
Skills Required
Project Budget
$30 - $250 USD
Completed In
2 days
Total Bids
8
Project Description

Scrape Simple Website with Screen-Scraper Software

Requirements:
(1) Experience with Screen Scraper
[url removed, login to view]
(2) Extensive knowledge with JAVA
(3) Must agree with standard Non-Disclosure/confidentiality reply

Scrape Workflow:
(1) Goto Index Page
One long index page list all the links to the details page, by date.
(2) Goto Details Page, by specific date
(3) Scrape the following
One Entry - Scrape approx 6 fields, which have only one entry
Multiple Entries - Scrape 1 field which contains multiple entries, seperated by pipe
Multiple Entries - Scrape 1 field again which contains multiple entries, seperated by pipe
(3) Write to TSV
(4) DL corresponding images

Challenges:
(1) Sometimes one important field isn't posted yet, skip the record.
(2) The two fields with multiple entries must match, i.e if we were using CSV it would look like this
...,line1-aaa | line2-bbb,[url removed, login to view] | [url removed, login to view],...
if there is no matching entry then write NULL, for example
...,line1-aaa | line2-bbb,[url removed, login to view] | NULL,...
(3) Since we will be running scrape looking for new information every 4 hours a day, don't write duplicates.

Project Due Date:
4-5 days after bid acceptance

Look forward to Bids

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online