Website scraping tool

Require some software or script to be built to scrape product data from The tool should not put the site under high load.

Need both brand and model product data scraped.

Index page for brands is here:

[login to view URL]

For models here:

[login to view URL]

For example, there are 2 products here that need to be scraped:

[login to view URL]

Fields required:

ItemID Price DiscountedPrice Compatibility Size Resolution Surface Type Backlight Type Replacement Part Type Video Signal Connector Mountings Display Technology Part Type Image Links Product Link

The tool needs to have good error handling. E.g. some pages take a while to load, and the tool needs to wait:

[login to view URL]

Some products may not have all of the above fields. It should scrape what is available.

There are also a few different types of indexes for the products, all which have slightly different layouts. The tool needs to cater for this. E.g.

[login to view URL]

[login to view URL]

[login to view URL]

[login to view URL]

Also, sometimes the site will stop sending requests and give a page similar to 404. In this case, the tool should pause, and try again in a minute. If the tool crashes, it should log the error and then save what it is up to into excel. Alternatively it should try and move to the next listing.

I should be able to select upfront whether to scrape brands or products. Then also be able to tell it which brands to scrape.

Skills: Web Scraping, Software Development

See more: website change website scraping, net website scraping job, website scraping service, website description tool, real estate website administration tool, php data scraping tool, website scraping web services, website scraping services, website administrator tool, backend website development tool review site, website scraping script, wedding website admin tool, data scraping tool, website thumbnail tool, website wordcount tool, converting website joomla tool, website scraping tool bidding, website scraping tool

About the Employer:
( 1 review ) West Footscray, Australia

Project ID: #21804645

Awarded to:


Hi. I am a freelancer working in 24/7 service. I have much experience for 6+ years in Scraping Field, I can do your job with crawler,scrapy, BS4 ,php, Selenium modules of python. I can make the csv , xlsx , sql , mogod More

$60 AUD in 3 days
(2 Reviews)

25 freelancers are bidding on average $161 for this job


Hi there, This is Lin and I am scraping expert, I have did many scraping projects, please check my reviews then you wil know. I have checked all details for your project, but there are some details that i want to dis More

$142 AUD in 3 days
(287 Reviews)

Hello Respect sir I saw your description, I can't stand the excitement of seeing the project you post on... I bet one's shirt on I have the ability to complete your project perfetly because I have experience with your More

$140 AUD in 7 days
(76 Reviews)

Hi, If you still need help please lets have a chat. Thanks Sorin

$175 AUD in 7 days
(44 Reviews)

hey, I have seen the website links you attached. I can make a SCRAPER script in PYTHON to get data from this website. The data extracted will be as per your requirements in the description. Would love to discuss mor More

$70 AUD in 1 day
(140 Reviews)

Hi there, Quality and time is my commitment. I have huge experience in working with these projects. If you need sample work just send me a message. Waiting for your quick reply. Best Regards Mohiuddin

$250 AUD in 5 days
(80 Reviews)

Hello, After reading your project details I believe I'm suitable for this project. As I'm expert on it with more than 7 years experience. Please feel free to contact me. I am looking forward to hear from you. More

$160 AUD in 3 days
(25 Reviews)

Hi, Using scripts, I can complete the list quickly with 100% accuracy. I am available to show you sample data before we start. For list that have different layouts, I can change script in process to get data from the More

$80 AUD in 5 days
(38 Reviews)

Hi there, I Have Scraped Amazon, Aliexpress, [login to view URL], Yellow Pages, Yelp, Zomoto Etc. I Have 500 GB Internet With 20 Mbps Speed. I Have 6 Systems. I can do it. I have done many related projects like this. If y More

$200 AUD in 5 days
(98 Reviews)

Dear Client. I respect you and will follow all your requirements and "[login to view URL]" webpage. I am so happy to see your serious project. Because your project is the perfect match for my s More

$180 AUD in 2 days
(19 Reviews)

I read your job post carefully. I can develop an automation script with python. I used python selenium, beautifulsoup, requests, excel, csv & panda packages in the past automation and scraping scripts. These are all r More

$135 AUD in 2 days
(2 Reviews)

Hi, There are two ways I can propose to do this project. One is that I can create an API (basically, a link) for you using which you can pull this data into an excel/ csv/ etc. I can also create options for you to cho More

$50 AUD in 2 days
(5 Reviews)

Hi, I am a software developer. I can create a desktop app to scrape the data.

$250 AUD in 0 days
(6 Reviews)

Hi, Nice to meet you! I am very interesting your project and I am confident of I can help your job. I am confident of this project as I'm a professional Scraping expert with over 7 years of experience. Seems to be an More

$200 AUD in 3 days
(4 Reviews)

Hello, I have read your requirement. I can perform this job very efficiently and within said timelines. Before awarding me the project, if you would like to have sample output then i will build and provide output for More

$200 AUD in 5 days
(4 Reviews)

Hi, We can do this job. We already have experience of scraping amazon items through luminatic proxies using node.js in the following site. [login to view URL] Please come over to chat to discuss in detail. Wait More

$140 AUD in 7 days
(1 Review)

Hi. I'm a Web Scraping Expert. I'm confident that I can do your work perfectly. Hope to contact. Thank you.!

$140 AUD in 7 days
(1 Review)

Hello Sir. As a web scraping and data mining, processing xpert, I am glad to place the bid on your project. As you can see in my profile, I am fully experienced and lots of skills in web development. I want to discuss More

$200 AUD in 3 days
(1 Review)

Hello How are you? I've read carefully your job description. I have more than seven years experience in Development. Your satisfaction with the project is my top priority! If you give me a chance to work with you, th More

$140 AUD in 7 days
(0 Reviews)

Hi, the task described well, thanks for that. I can build a scraping tool for this website today. It will work on Windows/Linux/macOS and will have all the requested functional including selecting brand/product and ini More

$200 AUD in 7 days
(0 Reviews)

Web Scraping Here!!! I have enough experience of webscraping for 3+ years and have a good deep knowledge of website development languages such as python, [login to view URL], ... I can work full time and will provide a good pro More

$140 AUD in 7 days
(0 Reviews)