Closed

Ice Cat Scraper

I need an expert web scraper to scrape a website for information, put this info into a database and create an Intranet site to parse this information.

I need a feasibility study first before commencement, the right programmer will be needed again in the future for additional work.

This will be a difficult project so you must have proven samples of your work, your code will be examined and tested.

Scrape [url removed, login to view] using a scraper with the following capability:

Phase 1 -

Read an excel sheet of products

Go to the ice cat webpage

Search a product by name, EAN, Manufacturer Number or product code (we will need to be flexible)

Retrieve product page

Grab the following

Text boxes

Specifications

Descriptions

Images

PDFs

Videos

Put the data into a database

Repeat for each product

Phase 2 - Export

Need ability to map data field

Example we might want Internal memory to map to a different word such as Memory

Allow data to map to additional fields

Example we might want Internal memory to map to Memory and also map to RAM (1+n number of fields)

Need ability to export all product data from database

Binarys to go in a folder based on product name

Text data to go to Excel File (master file)

Additional things

The scraper must be able to

Overcome all obstacles to retrieve its data, redirection scripts, cookies, leech protection etc

Cross navigate to get pictures from manufacturer websites, pictures must come back full size, uncompressed.

Rotate its queries through proxies specified in a proxy list to avoid any limits set by ip for HTTP requests, with an ability to set how many requests should be sent before changing proxy

The scraper must be bug free and well coded

Skills: Data Mining, Web Scraping

See more: grab data, web scraping free, web proxy free, tested and proven, scraping free, proxy free websites, master page samples, how to get a manufacturer, how to be an expert on excel, expert in excel for free, how to master excel, scraper map, ICECAT, http web requests, grab pictures, feasibility study , excel programmer needed, cat, cat products, c++ text mining, proxy videos, web scraping data map, feasibility study excel, web scraping free excel, based redirection

About the Employer:
( 4 reviews ) Dublin, Ireland

Project ID: #4832986

20 freelancers are bidding on average €528 for this job

happy2helpp

We can make this complete for your with quality. Please check PMB. Thank you.

€257 EUR in 4 days
(41 Reviews)
6.4
ehsankayani

HI, Kindly see details in PMB Thank you

€526 EUR in 7 days
(39 Reviews)
6.0
FINGERRPRINT

Hi. We are highly interested in the project. Please check private message for more details. Thank you

€526 EUR in 10 days
(17 Reviews)
5.7
diamond247

We are a big set up company with excellent skilled operator who have a lot of experience in this segment, lets talk in pm and see the sample

€515 EUR in 3 days
(31 Reviews)
5.6
alizza

Hello Ready to start!

€257 EUR in 3 days
(18 Reviews)
5.5
jitendraparmar07

Hello sir, Here [url removed, login to view] check your PMB for more details. thanks

€257 EUR in 3 days
(21 Reviews)
4.7
iDivya

Do read my message.

€320 EUR in 4 days
(12 Reviews)
4.6
amusto

I did a lot of scrapers. Please check my previous work.

€736 EUR in 30 days
(2 Reviews)
3.7
tuhindo82

Dear I have just seen your Job posting and upon reading thoroughly, I felt strongly that I would be the most qualified contractor for your project. I have vast experience in IT / project management / business plan a More

€722 EUR in 24 days
(4 Reviews)
3.1
zunden

hard job, but it can be done, let me help you to do this job

€466 EUR in 16 days
(1 Review)
2.2
anamaria1979

Hi, My names is James. I have read your project Description. It seems easy for me to work on this project. I am ready to discuss more about the project. I am offering you the minimum budget for this project

€277 EUR in 3 days
(3 Reviews)
2.1
noxtras

HI. Icecat actually has free api in the form of xml files. You don;'t need to scrape anything, just put the data in your DB.

€631 EUR in 10 days
(1 Review)
1.4
heyram1

Please see your pm.

€515 EUR in 3 days
(1 Review)
0.9
ipbanshee

Please see pm. Highly qualified, professional, scraping solutions.

€515 EUR in 3 days
(0 Reviews)
0.0
bhavishya

Hi, i can do this . i have good experience in java and java http library ,regex which is useful for this project

€722 EUR in 15 days
(0 Reviews)
0.0
LinuxScript

Lets get started.

€944 EUR in 20 days
(0 Reviews)
0.0
madhuhc

interested

€777 EUR in 3 days
(0 Reviews)
0.0
hamidelmi

I'm an expert in web development and familiar to your requirements. Eager to hear from you.

€555 EUR in 6 days
(0 Reviews)
0.0
imx

Hello ! I am Senior Python & PHP Developer and I am ready to start !

€255 EUR in 3 days
(0 Reviews)
0.0
creatorul

Professional solutions

€789 EUR in 10 days
(0 Reviews)
0.0