Closed

Amazon web scraper, web scraping into Magento MySQL database

Hi all,

We would like to scrape Amazon products with photos and import them into our Magento website ([url removed, login to view]) by providing a URL to scrape from.

The solution has to be as simple as possible.

For example, we would like to scrape all 9000+ products from the URL:

http://www.amazon.com/s/ref=sr_hi_3?rh=n%3A172282%2Cn%3A!493964%2Cn%3A541966%2Cn%3A1232597011&hidden-keywords=-B0089RPUHO+-B00DG0NUEE&ie=UTF8&qid=1385551805

Rules:

1) You must create a Magento ADMIN menu for the scraper (we are not interested in running scripts via SSH etc)

2) Scraped products need to match our product columns (we will provide you with a CSV file so that you know what info needs to be scraped)

3) Your scraper will need to interact with our MySQL database and archive products that are no longer available (the scraped data needs to go directly into our database, we are not interested in creating XML or CSV files for import)

4) We must have the ability to scrape by brand, category, price range etc

5) We need to scrape all product info as directed, for example: SKU, title, availability, price, colour, description, short description and so on

6) You need to be able to employ current anti-scraping methods: proxies, throttling etc

7) The scraper needs to have an UPDATE function where we can scrape a URL and only update certain attributes (ie. price, availability) - that way we don't have to scrape all items in full again

So in a nutshell, we enter a URL in our Magento ADMIN and the scraper starts importing all products into our MySQL database.

If you need to ask questions, ask before you bid.

We can provide ALL logins (SSH, FTP, ADMIN, cPanel, WHM) as we have a dedicated server.

Good luck!

Skills: Apache, Magento, MySQL, PHP, Web Scraping

See more: www-amazon-com, www amazon com, web scraping solution, web scraping price, scraping data from web database, scraping a server, mysql database server, dedicated server with whm, cpanel mysql database, anti web scraping, amazon price scraping, hidden web, xml scrape, xml file to csv for magento import, web solution web, web scraping products, web scraping amazon, url scraping, update magento website, scraping amazon, scrape amazon data, scrape a web, rh, magento update 18 to 2, create simple scraping

About the Employer:
( 34 reviews ) Sydney, Australia

Project ID: #5410332

13 freelancers are bidding on average $499 for this job

wildCat

Hi, My name is Marat, I am CEO of WEB4PRO development company from Ukraine. I have a team of skilled front-end and back-end Magento developers (4+ years of experience) which are ready to cooperate, communicate, sh More

$206 USD in 3 days
(289 Reviews)
8.3
p4provider

Hello, Here are Magento Experts , please check Our Latest Magento work In PMB For Our Experience and skills Regarding Magento projects and Let me start your work , 1. Easy access on IMs like Gtalk, Skype, Yah More

$1030 USD in 20 days
(128 Reviews)
7.6
dinastalb

Hello, I am Van Qaqi. I work with my partners Marlen at Netronian Inc., in Orlando, Florida. We have great experience with Magento. 80% of our developed websites are Magento websites. Never the less our perform More

$3225 USD in 30 days
(33 Reviews)
6.7
sainathkohta

Hello Sir, I am from Confianza Technologies. I have gone through your requirements. We have developers who have vast experience in required technologies. We are interested in your project, but before finalizing budget More

$750 USD in 18 days
(40 Reviews)
6.6
VnBestSolutions

Dear Sir, We claim to get it done perfectly for you EXACTLY in the way you want it - Kindly give we a chance and we will prove myself - Ready to prove our words, let's get it done right away and I mean RIGHT AWAY !! More

$568 USD in 7 days
(61 Reviews)
5.8
stevecorsi

Hi, Its Steve. Ready for the task. I am expert in scraping. Have scraped lots of sites before. You can find some of them in my [url removed, login to view] see my reviews and previous projects. Have scraped sites that require login More

$506 USD in 7 days
(26 Reviews)
5.6
zyeloncomputech

Hi sir, Thank you for giving opportunity for biding... we have gone through your requirements and we can build your Amazon web scraper module and import them into your Magento site according to your exact requireme More

$773 USD in 30 days
(26 Reviews)
5.4
mmadi

Hi, I'll be happy to do that for you. I have rich experince in scrapping using curl regular expressions Dom and Selenium RC. I worked for [url removed, login to view] and [url removed, login to view] search engine where I gain my experience More

$257 USD in 3 days
(20 Reviews)
5.2
shreeyait

Hello Sir, We have checked your job detail and as per that we are able to do your job and we have very good experience in Word Press, Joomla, Joomla component, Modules, PHP, HTML,Magento etc . As well knowledge on More

$412 USD in 12 days
(22 Reviews)
5.2
Handyman84

Hi, Don't want to bother you with some standard approach or random portfolio, so I will be straight to the point. This is our portfolio: [url removed, login to view] And here is our MAGENTO certification member. htt More

$1102 USD in 14 days
(4 Reviews)
4.4
Time2win

Hello, We have excellent team of programmers and designers to work on your project efficiently and complete job in time. We have read your deepest requirement at our best and will surely give better results. thanks

$257 USD in 10 days
(12 Reviews)
4.3
satishlogic1

Hi, I have 5+ years of experience in amazon,i done lot of amazon jobs before,i done 5 tools recently for amazon, please check my amazon jobs in my profile one is amazon scraper it will scrape all products accordi More

$388 USD in 10 days
(2 Reviews)
3.6
SuiGenSolutions

Hello Sir, We've done a number of web scraping projects for our clients. We have scraped many directory websites and e-commerce websites including amazon.com. You can look at some sample data here: [url removed, login to view] More

$220 USD in 7 days
(3 Reviews)
2.5
JalpeshGondaliya

Respected Sir, The following script lists items from amazon api by items asin and also gives facility to download items [url removed, login to view] [url removed, login to view] (Inp More

$222 USD in 3 days
(1 Review)
0.3
vijaywebsols

Hello Sir, We have a team of 50+ highly skilled employee .We will give you best result with in specified [url removed, login to view] give me few minutes for the technical discussion so we will get clear idea about your requiremen More

$206 USD in 3 days
(1 Review)
0.0
Noushin24H7D

Good day! After reading the project description, i am confident that i can do this job. I hope you will consider me for this job and i can start immediately. Thanks

$206 USD in 4 days
(0 Reviews)
0.0
dunitech

Dear Sir, I have read the job description of yours and the URL and ready to start work with you as i am having major expertise in Data scraping or web scarping and also with its related works. I am ready to show More

$263 USD in 3 days
(0 Reviews)
0.0
colwizsol

Dear Sir Hi, Greetings of the day and thanks for sharing these details and allowing me to bid on this assignment. yes we have similar experience and can deliver u as u have mentioned in your requirements. we More

$222 USD in 9 days
(0 Reviews)
0.0