Feasability Study Of Webscraping and Price Comparison Website

Closed

* DO NOT POST AUTOMATICALLY ON THIS PROJECT * All replies should be carefully considered.

I want to create a site comparing two competing websites and their online shopping prices. Each shopping system has approximately 20 000 items and uses different technologies for their cart systems. One is quite advanced and uses ajax, the other is from the dark ages and uses frames. I am wanting to create a weekly comparison of these 20,000 items.

This involves:

1. Weekly automated webscraping of existing items without getting banned

(i.e. the updates may need to be batch jobs to prevent being banned from the sites)

2. Identification of new items added to each of the sites.

3. The creation of a shopping cart system that will create two shopping carts, effectively allowing the customer to compare prices at the end and

decide which provider to go with.

4. Ability to create reports comparing goods across a category or brand.

These requirements are simplified. Further details can be provided upon request for suitable / non-automated replies. What I am looking for is someone who can explain a method of doing this.

The deliverable will be to produce a diagram (using BPMN and / or UML) and a short description on how this would work, including the key steps involved.

I have a background in IT and Business Analysis so this should be quite simple to communicate to me. I have already had a look at the source code and would be willing to get up to speed with the required technologies. I already have an idea of how this may work, though have limited exposure to Web Scaping.

Given that this is a feasibility study, I'm not wanting to spend a lot on it.

Skills: Business Analysis, Data Mining, Research, SQL, Web Scraping

See more: website creation jobs online, web research jobs online, uml jobs, uml for sql, steps on how to create a website, sql online jobs, sql jobs online, shopping carts for websites, scaping, research jobs online work, online web research jobs, online sql jobs, online shopping jobs, online research reports, online jobs research, online analysis jobs, new technologies in online business, jobs online research, jobs in online research, jobs doing research, jobs doing online research, how to study in website creation, how to look for jobs online, how to get website exposure, how do i need to create online shopping website

Project ID: #4019505

8 freelancers are bidding on average $179 for this job

funnyhoney

PMP, MBA and professional market researcher here. Skills include market research, competitive analysis, horizontal and vertical market integration strategies, web marketing and brand building. My report will be thoroug More

$250 USD in 7 days
(79 Reviews)
7.2
mantislin

Hi sir, please check PM, thx Kimi.

$250 USD in 5 days
(90 Reviews)
6.4
webscrapinggurus

I am bidding only on the portion of the job of scraping data from the 2 existing sites. I have a ready proxy solution that will easily allow me to megascrape these sites and my specialization is in scraping and parsin More

$150 USD in 9 days
(28 Reviews)
5.9
renanreis

I can develop this price comparision system

$140 USD in 7 days
(5 Reviews)
2.6
szdezso

I have 7+ years of experience in the areas of: SOA-based workflow solutions (a number of successful projects in Lombard Leasing Inc.), webservices (C#, Java, PHP, db design, implementation), desktop/web apps (client-se More

$250 USD in 5 days
(0 Reviews)
0.0
plasmob

Hi I have written lately integration projects for AJAX heavy sites. Same tools could be used for webscraping, my approach lies on browser automation which is only proper way to get trough AJAX. Can be done headless on More

$100 USD in 5 days
(0 Reviews)
0.0
VR26

We are a Web design and development company that focuses on regular communication with our clients and timely delivery for all our projects. Some of the technologies/area that we focus include:

$150 USD in 11 days
(0 Reviews)
0.0
X3V5hYLs0

We are freelance software developers. If you contact me I can give a quote for your project and we can discuss the details. <b><i>Removed by Admin</i></b>

$140 USD in 1 day
(0 Reviews)
0.0