Data extraction from websites with JavaScript / jQuery

This project received 9 bids from talented freelancers with an average bid price of $ USD.

Get free quotes for a project like this
Employer working
Project Budget
$250 - $750 USD
Total Bids
Project Description

Application description:
You will help us develop a JavaScript / jQuery based tool that is used to grab content from various websites to save it to a user's profile on our application. We are looking for particular data (images, price, product description, title, etc.) for around 250 sites, and this is involves individual approach to particular sites. Your job will be to explore the structure of the sites we provide, and to extract the particular data from the DOM of those sites.

The tool already has a solid base for you to work on, so you should be prepared to adapt to a ready environment and all implied coding standards and nomenclature, able to write clean, comprehensive and efficient code.

This means you'll be dealing a lot with jQuery selectors, traversing the DOM, dealing with events and triggers, dynamic content and other stuff that might pop up for particular systems. Albeit the task is slightly repetitive, individual approach to _each_and_every_ site is required to provide valid, well formatted and also beautiful content. Obviously you should be aware of the dynamics of sites and potential differences due to browsers or user settings (logged in / guest user) etc.

There are about 250 web sites to set up, and we have found it takes an average of 15 minutes to set up one site. >>>Please reach out to me with your Skype information to test and see how long it takes for you to process (you may send over your Skype name through the PM system). Also, if you give it a shot and we can tell you know how to do this, we will be more likely to hire you (we will not award the project to anyone who does not test first – otherwise you’ll have no idea how long this should take and won’t be able to make an accurate bid).

Technical requirements:
>Proficiency working with jQuery and JavaScript
>Thorough comprehension of the website DOM, HTML 5 data attributes, general data hierarchy and structuring; retrieving data via DOM attributes and CSS rules.
>Understanding of Regular Expressions (REGEX).
>Quick learning and willingness to look into problems individually, ability to read, explore, search and comprehend custom APIs running in the back end of a site.
>A fair understanding of what clean and standard-compliant coding means, willingness to adhere to a preset code nomenclature; documentation and commenting code.
>A good grasp on web and coding terminology, prompt response for proper communication with other developers
>Own web-server and work environment recommended

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online