Closed

Web Scraping Project

This project received 35 bids from talented freelancers with an average bid price of $139 USD.

Get free quotes for a project like this
Employer working
Skills Required
Project Budget
N/A
Total Bids
35
Project Description

I need someone for a simple scraping project. I will provide you a login, you will scrape a site and provide a database.

There are two pages I want to scrape:
1. A resume page
2. A personal info page

The pages have URLs that is in this format:

http://{url_for_info}?id={id}
http://{url_for_resume}?id={id}

All you need to do is log in, scrape the page, then increment the id + 1 and repeat the process until there are no more entries. The exact page screenshots are attached below.

Notes:

- LOOK AT THE SCREENSHOTS!!! Make sure you can scrape and store that data before you reply.
- Do not scrape too fast. This should not attract attention or look like a DDOS. Fly casual.
- Use proxies to simulate different access points.

DELIVERABLES:

I WILL PROVIDE...
1. URLs to scrape
2. Screenshots for the site
3. Login to access
4. Prompt payment upon completion

YOU WILL PROVIDE...
1. A SQL, MySQL or Access Database containing the data. If you have another format, let me know in advance. NO EXCEL!!!! NO CSV!!!! I want to be able to set this up as a data source immediately, so you MUST provide the data as a database file I can access or restore.

2. The database should have at least two tables: Info and Resume. Note that the resumes have multiple entries, so you may need to set up additional tables to handle that.

COMPLETION...
This project will be considered complete once you have delivered the file and I have been able to access the data.

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online