Closed

Web scraping data for different sites

This project received 23 bids from talented freelancers with an average bid price of $586 USD.

Get free quotes for a project like this
Employer working
Skills Required
Project Budget
$250 - $750 USD
Total Bids
23
Project Description

Dear,
Hope you are well!!
,,,,,,,,,,,,,,,, The price will give to me for scraping data from 25 web shops ,,,,,,,,,,,,,,,,,,,,,,,,,,,,,Please read it carefully before you bid
I need someone to scrape products from
25 web shops USING PHP Language through VPN ( Hide my IP ) to my Price compare site.

Note: 25 web shops with different structure

We need to scrape all the data as cron job ( each 12 hours ) from our suppliers webshop and import to our server through FTP access as XML and Updating the data each 12 hours.

Scrap data:
- Product name
- Product Category
- All Sub Categories (if available)
- Product Brand
- Product deeplink
- Product Price ( if there is any OFFER PRICE should be showing instead of the Normal price)
- Product Images (images in folder and filenames in separate csv file)
- Product shipping ( Delivery cost )
- Payment method
- Product last updated

This is a sample on how this should be done and the URL to scrap.
[url removed, login to view]

The extracted data should be provided in XML files. Sorted by supplier category - from the top.

Things to be done in step:

1- Scrape all the data ( Products , category , Brand , images .... etc)from over the web shops.

2 - Output the scrape data as XML format, the xml format link u can see some example:
[url removed, login to view]
Should generate a error message that show me if some problems happened with scraping


3- Import the XML to our server through FTP access ( Updating the old file ) after the scrape finish.

4- This will simply work with certain setting and cron set up in that plugin

- Note: The web shops STRUCTURE are not the SAME.
- I need this done within 10 days from winning bid.
- I need to scrape data from one web shop and send me a XML file as prove, you are able and understand the task.
- No cure no pay - everything need to be 100% clear with no errors or what so ever. So can you not complete this task 100% then please don't bid on this project?

- All data must be delivered and reviewed before release of payment.
- I need you to accept this task terms in your PM when placing your bid to confirm you are 100% understand what I need you to do.
Thanks,

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online