[url removed, login to view] library development for [url removed, login to view] - Detecting Search Engines and Sending Requests over HTTP

This project was successfully completed by jibyjose001 for $736 AUD in 2 days.

Get free quotes for a project like this
Project Budget
$250 - $750 AUD
Completed In
2 days
Total Bids
Project Description

[url removed, login to view] is a service for intercepting requests from Search Engine robots and providing a scraped full HTML representation for JS enhanced web applications that cannot be indexed normally.

Basically a robot (HTTP client) sends a request to a site, and that site uses a SnapSearch client to detect if this request comes from a robot, and then sends a request to the SnapSearch API service, retrieves the content and returns the content back to the robot.

We need a [url removed, login to view] developer to develop an HTTP client library for SnapSearch. We have already developed a PHP version, however we do not have the skills to create a node equivalent.

This library is consisted of 3 parts. The first part is to detect whether the HTTP request is a robot. This means looking at the user agent of the HTTP request, along with other features of the request. The second part is to send an HTTP POST request to the SnapSearch API and retrieve the content. The last of part simply combines these 2 together in a simple to use internal DSL for developers to integrate into their applications. The integration location should be in their Front Controller or Middleware equivalent.

Before I go into more detail of the task. Please see the PHP equivalent of this library job: [url removed, login to view] Make sure to read the Usage description and the Source Code + Comments.

The API is already launched, however there isn't a front end explaining this service yet. However the explanation for how all the clients should work is here: [url removed, login to view]

I am willing to have a Skype Chat to talk over the library development specifics and help with various technical tasks, and I work in JS front end development so I can read your source code.

See the attached file for the specifications regarding the development of this library. It is in markdown format, but also an HTML version too!

Completed by:

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online