Google / Multi-website crawler

This project received 17 bids from talented freelancers with an average bid price of $294 NZD.

Get free quotes for a project like this
Employer working
Skills Required
Project Budget
$250 - $750 NZD
Total Bids
Project Description

Primary crawl:

To crawl through a list of websites from a csv file.

Secondary crawl:

To search in google for a business name and crawl through the first 3 results.

Input file for primary crawl: CSV file of a list of websites

Input file for secondary crawl: CSV file of list of business names

Output file in both cases: To save details from contact us and about us pages of these websites in seperate columns. Search for keywords like 'manufacturing', 'import/export', 'retail' etc and if any content is found on the websites, the program needs to extract the paragraph containing the text in a column below the keyword.

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online