Can you package (mine) data if i told you where you could find (crawl) it?

Closed Posted Apr 5, 2014 Paid on delivery
Closed Paid on delivery

Loyalty programs have complicated reward structures where it is unclear as to the precise value they provide. Simplifying that complexity is the goal of this tool that i’m looking to get built.

When you fly an airline, stay in a hotel, ride a bus, swipe a credit card, shop at a certain store (online or offline), you get more than the product or service you just purchased. You get frequent flyer miles or loyalty points. But what exactly do you get and when remains unclear. Not just that, but what these points are worth is almost never evident.

The idea is to build a tool that can crawl websites which answer these questions.

What i will provide -

1. Use case scenarios

2. Destination site from where data needs to be crawled

3. The variables which need to be searched (questions)

4. The nature of output required (answers)

What i am expecting -

1. A database designed to store these pieces of information

2. An interface that allows me to select the input variables based on which the application will crawl the specific websites, extract the relevant information, store it in the database and display it on a front-end for me to consume

3. A front end where i can input any url of my choice and run a query to get a result with the same variables (from, to, type of booking, class of travel, etc.)

Some other hygiene factors -

1. Documentation that explains precisely how the application has been built so that any engineer inheriting this code knows how it was designed

2. A demo to understand how the tool works

3. A presentable front-end sufficient for a layman/non-engineer to interact with

4. Timelines required to build this along with periodic updates on the progress

Also keep in mind -

This is one of several projects lined up. Based on the quality of this tool, i will look to further build on this application and integrate it with my existing platform.

Data Mining Data Processing PHP Software Architecture Web Scraping

Project ID: #5765507

About the project

6 proposals Remote project Active May 20, 2014

6 freelancers are bidding on average $453 for this job

Towhidd

A proposal has not yet been provided

$1666 USD in 30 days
(31 Reviews)
4.3
amivy

I am hard working and take my work seriously. I will make your work my priority if you entrust me with it. Give me the chance to prove myself.

$155 USD in 3 days
(0 Reviews)
0.0