Closed

Web Scrapper

This project received 5 bids from talented freelancers with an average bid price of $230 USD.

Get free quotes for a project like this
Employer working
Project Budget
$30 - $250 USD
Total Bids
5
Project Description

Hi
I need a software to scrap / parse / aggregate / job postings mainly from career websites , company career pages, also from newspapers or job boards.

Must have features:

Spider jobs from websites (HTML or XML), ATS or via FTP.
Jobs taxonomy for categorization based on job titles & keywords.
Then the job ads should be converted into the correct format for my job board. Semantic analysis should be used, to ensure the content is accurately mapped onto my job board’s category schemes
The capture has to be at the highest possible data to be parsed on a job site and it would contain the entire job advertisement.
Incremental scraping feature only downloads new jobs.
Synchronize jobs to guarantee that only open jobs remain posted.
Filter jobs by keywords so only relevant jobs are posted.
Auto-replace keywords in content & clean up job formatting.
Schedule regular spidering / posting sessions.
Auto-post via XML, EXCEL or CSV to single or multiple websites or forward to a list of emails.
Post to HTTP interface, via API, SOAP, to FTP or email.



The software will scrap the entire posting of the job openings that will be found in the career pages of the website. The software product should be build in a way which will allow me to give only the web adress of the career section of the website to be parsed and the software product will do all the rest. This is really a must have. If needed I shall provide for you all the adresses of the career sections/pages to be parsed or at least most of them.

Very important: I need to have perfect accuracy of the scraped content - text, url, images. The engine has to be able to scrap at least 600000 career pages / day (which will come from arround 30000 web-sites/day), convert them into XML, EXCEL, or similar files and post them on my job board website or spread them to other job boards.

The software should be able to do at least what the following two are doing:
[url removed, login to view]
[url removed, login to view]

Thanks

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online