Web scraping data for different sites

Budget $250 - $750 USD
Bids 23
Average Bid $586

Hope you are well!!
,,,,,,,,,,,,,,,, The price will give to me for scraping data from 25 web shops ,,,,,,,,,,,,,,,,,,,,,,,,,,,,,Please read it carefully before you bid
I need someone to scrape products from
25 web shops USING PHP Language through VPN ( Hide my IP ) to my Price compare site.

Note: 25 web shops with different structure

We need to scrape all the data as cron job ( each 12 hours ) from our suppliers webshop and import to our server through FTP access as XML and Updating the data each 12 hours.

Scrap data:
- Product name
- Product Category
- All Sub Categories (if available)
- Product Brand
- Product deeplink
- Product Price ( if there is any OFFER PRICE should be showing instead of the Normal price)
- Product Images (images in folder and filenames in separate csv file)
- Product shipping ( Delivery cost )
- Payment method
- Product last updated

This is a sample on how this should be done and the URL to scrap.
[url removed, login to view]

The extracted data should be provided in XML files. Sorted by supplier category - from the top.

Things to be done in step:

1- Scrape all the data ( Products , category , Brand , images .... etc)from over the web shops.

2 - Output the scrape data as XML format, the xml format link u can see some example:
[url removed, login to view]
Should generate a error message that show me if some problems happened with scraping

3- Import the XML to our server through FTP access ( Updating the old file ) after the scrape finish.

4- This will simply work with certain setting and cron set up in that plugin

- Note: The web shops STRUCTURE are not the SAME.
- I need this done within 10 days from winning bid.
- I need to scrape data from one web shop and send me a XML file as prove, you are able and understand the task.
- No cure no pay - everything need to be 100% clear with no errors or what so ever. So can you not complete this task 100% then please don't bid on this project?

- All data must be delivered and reviewed before release of payment.
- I need you to accept this task terms in your PM when placing your bid to confirm you are 100% understand what I need you to do.

Post a Project Like This

Looking to make some money?

  • Set your budget and the time frame
  • Outline your proposal
  • Get paid for your work

Bids on this Project

  • heyram1 Profile Picture


    Hyderabad,  India

    Mindtech Solutions is an IT and IT enabled services provider. We are specialized in Hosting Services (mainly Dedicated Servers and VPS) , Affiliate Marketing, Email Marketing and Online Promotions. lets know if you need any kind of services from our vertical . You can reach us any time via freelancer. Performance Driven Global Ad Network Reliable Hosting Solution Reliable Email Service Provider Thanks

    Mobile Phone, Research, Telemarketing, and AJAX

  • raul27868 Profile Picture


    Madrid,  Spain

    I'm specializing in website data scraping. I have developed software that performs data collection. I'm specializing in website data scraping. I can develop software in languages​​: Perl, PHP and Javascript I can perform installations and settings for Joomla and WordPress

    PHP, Perl, C Programming, and Javascript

  • SigmaVisual Profile Picture


    Taxila Cantt,  Pakistan

    Web, Bots, Crawlers, and Scrapers Development. I have expertise in automation services and I can automate any manual process.

    PHP, ASP, C Programming, and Javascript

  • ruhulamin24 Profile Picture


    Dhaka,  Bangladesh

    Get wordpress modified to achieve your goal. - Theme modification - plugin modification - css design modification - wordpress core features modification using hooks and filters Bug fixing Theme Issue - responsive issue - browser compatibility issue - activation error Plugin issue - activation error - feature not working other issue - permalink issue - rss feed issue - white screen of death - migration issue - js error - redirection issue - ssl issue - malware removal - database connection error - email sending issue - memory issue - permission issue - update failed - site slow - 404 error - internal server error - high CPU usage

    PHP, C Programming, Javascript, and Website Design

  • uumairkhalid Profile Picture


    Mirpur Azad Kashmir,  Pakistan

    Hello It's Umair here. I am an experienced freelancer with more than 5 years of experience in web scraping Field. I have worked with big & small companies from all over the world and i know how fulfill client requirements. Client Satisfaction is my priority not the money. I am providing following services here: ✔ Web scraping ✔ Data Mining ✔ Email Scraping ✔ Lead Generation ✔ Database Creation ✔ Business list creation ✔ Web Research. ✔ Business directory Scraping I Guarantee you high Quality work with 100% accuracy. Consider me the best option for your project and i will never disappoint you. Thanks

    Python, Internet Marketing, Banner Design, and Logo Design

  • zeke Profile Picture


    Hidden,  Russian Federation

    Expert PHP/MySQL developer with over 6 years of experience. My bid is for fast professional service exciting my customers.

    PHP, C Programming, Java, and Javascript

  • daziabey Profile Picture


    Awissavella,  Sri Lanka

    To become an Unique, with a professionally and practically sound career who achieves targets with dedication and teamwork with full of customer satisfaction.

    Java, Javascript, Adobe Flash, and Website Design

  • akhila27 Profile Picture


    Eldeniya,,  Sri Lanka

    Hi, My name is Akhila Praveen. You can call me Akhil. I'm the Managing Director of 'Solution Infinity'. What may you ask ? Solution Infinity is a place where along with my dedicated team members we undertake your software and application needs and develop them for you, from the nut to the shell,even better than you imagined it would be. I know not all are talented programmers, and yes it is hard to do your programming alone, or sometimes you discover your knowledge is not enough and cant wait till you gain it, or even worse your a non-IT/programming person looking for a Soft ware/application solution for your business/PC. That is where we step in, we will take your burden from those shoulders and provide you what you will admit is simply the best IT solution that can be catered. Our charges you ask ? No worries, All this doesn't include a bill like you dined at Hilton hotels, We will be charging fair, fitting to your budget. So why don't you take a peak around ? there are some project's we've done, and my crew at work, plus there is also my contact info you to contact me for your IT needs. Remember - Solution Infinity, the Solutions are Infinite!!!

    PHP, C Programming, Java, and Javascript

  • sirajcse Profile Picture


    Dhaka,  Bangladesh

    Programming Languages: Ø PHP, JSP, jQUERY, AJAX Ø Crystal Report, SMARTY Ø MySQL, MS Sql,SQLITE Ø JAVA

    PHP, Javascript, XML, and Internet Marketing

  • rajkavikumar Profile Picture


    Mumbai,  India

    We are a group of automation service providers. We have more than 6 yrs of experience in providing automation services. We have expertise in creating web crawlers (web query) for data scraping & data uploading projects, We have completed lots of web crawlers which we have made for different Directories and database sites like amezon.com, Monster.com, Monster.co.uk, yellobook.com, hoovers.com, www.usacycling.org, www.ic.gc.ca, www.idealist.org, www.die-werbeagenturen.ch, www.yelp.com, www.asic.gov.au, www.abr.business.gov.au and for many sites. We also have created Automation for report geneartion.

    PHP, C Programming, Visual Basic, and Data Processing