Closed

i need a software that will scrape the whole website

This project received 25 bids from talented freelancers with an average bid price of $340 USD.

Get free quotes for a project like this
Project Budget
$30 - $250 USD
Total Bids
25
Project Description

i need a software (run on windows server 2012) that will scrape the whole website, so i will be able to view the whole website offline, the functions listed below:

1. able to input multi URL with CSV

2. will base on the URL to scrape the whole website with all images (deep with 5 hyperlinks)

3. after scrape it, the software will change all hyperlinks or image url as local (like [url removed, login to view] in the html file, then it will change like as /[url removed, login to view] only)

4. each scraped page will store in the output folder, the folder name will included in the CSV file

5. able to scrape with multi thread so can speed up the scrape process

i will send the sample of the CSV file and also a similar scrape plugin for reference.

Here is the similar concept plugin from Firefox for reference: [url removed, login to view]

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online