WebScraper -- 2

Cancelled Posted 7 years ago Paid on delivery
Cancelled Paid on delivery

I need a Web Scraping application to scrap reviews of products in polish website ceneo.pl. It has to work as an ETL process. Extract, Transform and Load. Extract raw data, then transform it to get useful, clear data and last, load it to database.

Data to be scraped for each review (by class):

a. product-reviewer (if lack of info, it shoul write "Anonim")

b. reviewer-recommendation

c. datetime (when posted)

d. review-score-count

e. product-review-body

f. pros

g. cons

h. vote-yes-(some number?) vote-no-(...) How many thumbs up and how many down. If "0", then it should remain empty in database.

4. Data to be scraped for each product:

a. Device Type

b. brand

c. Model

d. Additional comments

First user need to input ID of a product (e.g [login to view URL] the number is ID) to scrape, then should be 2 buttons: [Extract Tranform Load] - which should stop after each step (Extract -> output of raw data [continue button] Transform -> output clear data [continue button] Load -> output data loaded to DB [Back to choices button with question - "Do you want to clear DB?" if yes -> clear and show home page, if no show home page]) and [ETL] which should show the final data in database (with the same back to choices button as before).

Application must have a button to clear database in home page too, to show how it is loaded, and app should delete every single file used for the ETL process when it is finished. Of course it can't be any duplicates in database. There should be an information about how many reviews was scraped. Of course it should work for all subpages if there is any.

The application should allow the display of opinions from the database by product which they discribe. There should be an option to export all scraped data to .csv file and each review to .txt file (e.g a button next to review, and a button to export all scraped data to csv).

I prefer PHP curl and simplehtmldom libraries, html5, bootstrap and MySQL for it.

I does not have to look extraordinarily, it has to work.

I need this app no later than 12 january 2017.

Thanks in advance!

Edit: I need it till tomorrow 13.01.2017!!

I need it till 14.01.2017!!!

Data Entry HTML5 MySQL PHP Web Scraping

Project ID: #12766854

About the project

9 proposals Remote project Active 7 years ago

9 freelancers are bidding on average zł79 for this job

mantislin

Dear sir, I am scraping expert, I have did too many scraping projects, please check my reviews then you will know. Can you tell me more details? then I will provide example data/script for you. Thanks, More

zł75 PLN in 2 days
(509 Reviews)
8.1
Harun1986

Dear Sir, I will provide you Current data from (source website). Also, I can scrap after login from current data Scraping source website, I Will follow (name, details (Email, phone, website, etc ) If the Source site d More

zł75 PLN in 1 day
(221 Reviews)
6.8
emamulbd

Dear Client, Your job posting catches my attention and I submit the proposal as a desired candidate. I'm a full time freelancer experienced in Web Scraping,Lead Generation, Virtual Assistant, PDF conversation, Socia More

zł75 PLN in 1 day
(89 Reviews)
6.3
banzsolt

Hi I would be able to create this by tomorrow, but I would rather build it in ruby on rails since I have more expertise in that. If this fits your need I am up for doing it overnight for the price specified in my bi More

zł166 PLN in 1 day
(1 Review)
0.0