Web site scraping/mapping v2

Budget $250 - $750 AUD
Bids 13
Average Bid $415

THIS IS BEING REPOSTED BECAUSE I MISSED ATTACHING THE FILE

We need the following:

For each of the six sites below, we need to get a map of the product hierarchy and the number of product within the lowest category.

The result will look like the spreadsheet attached. There will be 6 spreadsheets, one for each brand. Each with 3 tabs

We also need a screen grab of just the main menu for when you hover over the top menu and the left hand nav when you click on each of the top menu’s. So each spreadsheet will have twice the number of images as there are top level menu categories. You can use FireShot for this


This is going to require some intelligence in the way it is approached to work out how the site actually navigates to each category. This can also vary by area within the site e.g. electronics different to toys. However once you figure it out, it is easy. E.g. John lewis – for Toys, click, on by age and then click on toys by age, and then view all. Then you can copy them to notepad and then into excel

Each of the web sites approaches the category presentation differently.

The way to get the hierarchy is to click on each of elements of the main menu, then scrape the categories on the left hand nav, then click on each and scrape the left hand nav categories again until there are no more categories. REMEMBER – each site gets you to categories differently. When there are no more categories below, you need to get the number of products in the lowest level category. This can be got from either the number of in the lister page, or the number of results in brackets next to the field of price in the left hand navigation.

You can do this manually or automatically. We estimate it is 3-4 man hours per site, though have not proven this. You have to make your own judgement. The maximum revision to price if it takes longer than expected is 15%

Needs to be completed within 3 days.

Sites are:
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]

Post a Project Like This

This project was awarded to

About the Freelancer

Looking to make some money?

  • Set your budget and the time frame
  • Outline your proposal
  • Get paid for your work

Bids on this Project

  • WHc84uKL3 Profile Picture

    WHc84uKL3

    Adana,  Turkey

    SOLVER COMPUTATIONAL SERVICES

    PHP, C Programming, Java, and Javascript

  • akhila27 Profile Picture

    akhila27

    Eldeniya,,  Sri Lanka

    Hi, My name is Akhila Praveen. You can call me Akhil. I'm the Managing Director of 'Solution Infinity'. What may you ask ? Solution Infinity is a place where along with my dedicated team members we undertake your software and application needs and develop them for you, from the nut to the shell,even better than you imagined it would be. I know not all are talented programmers, and yes it is hard to do your programming alone, or sometimes you discover your knowledge is not enough and cant wait till you gain it, or even worse your a non-IT/programming person looking for a Soft ware/application solution for your business/PC. That is where we step in, we will take your burden from those shoulders and provide you what you will admit is simply the best IT solution that can be catered. Our charges you ask ? No worries, All this doesn't include a bill like you dined at Hilton hotels, We will be charging fair, fitting to your budget. So why don't you take a peak around ? there are some project's we've done, and my crew at work, plus there is also my contact info you to contact me for your IT needs. Remember - Solution Infinity, the Solutions are Infinite!!!

    PHP, C Programming, Java, and Javascript

  • alizza Profile Picture

    alizza

    EHELIYAGODA,  Sri Lanka

    We Provide =>High Quality Email Database =>Web-Scraping =>Email Extract,Validate and Cleaning =>Email Marketing

    PHP, Data Processing, Data Entry, and Excel

  • ehsankayani Profile Picture

    ehsankayani

    Islamabad,  Pakistan

    I am a C#/ Asp(.)net (Website and Software Developer). And have strong knowledge in the skills listed below: 1- C#, Javascript, Asp(.)net, jQuery , Html,Css 2- Windows Services 3- Web Services 4- Windows Form Application,Windows Console App ( Desktop Application For Windows) 5- Automated Softwares (Ex . Linkedin Bot to Post on Groups, Send Messages etc) 6- Scraping Tools, Crawlers , Web Spiders. 7- Sql server (05,08,12) , Visual studio (10,12) , 8- Access / Excel VBA Tools 9- And at the moment learning Xamarian , for Android / IOS & windows phone development. You will see reviews on my profile from all the skills listed above and many more and every review marks my services as 100 % perfect. Also i always provide quality work in less price and on time. You can see that from my project reviews listed on this profile. Also i am almost online 17 + hours a day so my response time is very quick . Thank you

    PHP, .NET, Internet Marketing, and Banner Design

  • webscrapinggurus Profile Picture

    webscrapinggurus

    los angeles,  United States

    I got started in programming when i discovered and used a loophole in Google's image search algorithm in 2010. I soon after started freelancing jobs on freelancer. I have since worked for a company near San Fransisco called Datanyze as a web crawling engineer. I focus primarily on designing web crawlers / scrapers and collecting business, ecommerce, social and other data from the internet. I have built scrapers for Google Maps, Google search, Yelp, Hoovers, yellowpages, ebay, amazon, homeaway, zillow and more. Primary languages: Python, Javascript, PHP, C# Familiar technologies: MySQL, AWS, Lxml, Jquery, selenium, phantomJS, regex, Lxml, Beautiful Soup, JSON, XML, html, css, LAMP Project highlights: I automated the creation of over 20,000 Google accounts to create API access and collect places data. designed a bot to intereact with users and collect email addresses from websites like AirBNB and HomeAway.

    PHP, Javascript, Python, and Internet Marketing

  • naren901 Profile Picture

    naren901

    Visakhapatnam,  India

    I have 5 years experience in programming. I am good in Visual basic and Standalone application. I am best in web scraping projects.

    PHP, XML, Python, and Visual Basic

  • bob1982 Profile Picture

    bob1982

    Patiala,  India

    I am a professional newcomer into the area of .NET. I have great experience in the similar areas of Advertising and Android. I have got excellent proficiency and training as a C# Programming Developer and C++ Programming Developer as I have taken up various projects in these areas. I am ready to start working for you. Hire me and I will put in my best effort to bring laurels to your company.

    PHP, Java, XML, and Python

  • PeterN Profile Picture

    PeterN

    Cairo,  Egypt

    Web and Software Development

    PHP, Java, Javascript, and XML

  • sy3d Profile Picture

    sy3d

    Okara,  Pakistan

    I am expert in many fields and my main goal is providing an awesome freelance experience. I am effective at multitasking, problem solving and I offer exceptional professional services and advice. I make sure I go above and beyond to meet your requirements and exceed your expectations. I always provide top notch services and meet deadlines as required. My services are wide in range and not only limited to the list below:- * Photo Editing * Logo Design * Graphic Design * Banner Design * WordPress * Data Entry Online/Offline * Downloading / Uploading * PDF Forms * PDF Conversion * Web Scrapping * Excel * Excel forms * Word * Power Point * Database Development * Document Conversion * Data Retrieval from Websites * Product uploading (all platforms) * Internet research * OCR * Preparing Spreadsheets (Csv, .xls) * eBay & Amazon (Listing) * Facebook, Youtube Services

    Visual Basic, Script Install, Banner Design, and Data Processing

  • greggfletcher Profile Picture

    greggfletcher

    Popovo,  Bulgaria

    5 years of experience in web scraping .

    PHP, XML, Visual Basic, and .NET