Amazon web scraper, web scraping into Magento MySQL database

Hi all,

We would like to scrape Amazon products with photos and import them into our Magento website ([url removed, login to view]) by providing a URL to scrape from.

The solution has to be as simple as possible.

For example, we would like to scrape all 9000+ products from the URL:!493964%2Cn%3A541966%2Cn%3A1232597011&hidden-keywords=-B0089RPUHO+-B00DG0NUEE&ie=UTF8&qid=1385551805


1) You must create a Magento ADMIN menu for the scraper (we are not interested in running scripts via SSH etc)

2) Scraped products need to match our product columns (we will provide you with a CSV file so that you know what info needs to be scraped)

3) Your scraper will need to interact with our MySQL database and archive products that are no longer available (the scraped data needs to go directly into our database, we are not interested in creating XML or CSV files for import)

4) We must have the ability to scrape by brand, category, price range etc

5) We need to scrape all product info as directed, for example: SKU, title, availability, price, colour, description, short description and so on

6) You need to be able to employ current anti-scraping methods: proxies, throttling etc

7) The scraper needs to have an UPDATE function where we can scrape a URL and only update certain attributes (ie. price, availability) - that way we don't have to scrape all items in full again

So in a nutshell, we enter a URL in our Magento ADMIN and the scraper starts importing all products into our MySQL database.

If you need to ask questions, ask before you bid.

We can provide ALL logins (SSH, FTP, ADMIN, cPanel, WHM) as we have a dedicated server.

Good luck!

Skills: Apache, Magento, MySQL, PHP, Web Scraping

See more: www-amazon-com, www amazon com, web scraping solution, web scraping price, scraping data from web database, scraping a server, mysql database server, dedicated server with whm, cpanel mysql database, anti web scraping, amazon price scraping, hidden web, xml scrape, xml file to csv for magento import, web solution web, web scraping products, web scraping amazon, url scraping, update magento website, scraping amazon, scrape amazon data, scrape a web, rh, magento update 18 to 2, create simple scraping

About the Employer:
( 34 reviews ) Sydney, Australia

Project ID: #5410332

13 freelancers are bidding on average $499 for this job


Hi, My name is Marat, I am CEO of WEB4PRO development company from Ukraine. I have a team of skilled front-end and back-end Magento developers (4+ years of experience) which are ready to cooperate, communicate, sh More

$206 USD in 3 days
(289 Reviews)

Hello, Here are Magento Experts , please check Our Latest Magento work In PMB For Our Experience and skills Regarding Magento projects and Let me start your work , 1. Easy access on IMs like Gtalk, Skype, Yah More

$1030 USD in 20 days
(128 Reviews)

Hello, I am Van Qaqi. I work with my partners Marlen at Netronian Inc., in Orlando, Florida. We have great experience with Magento. 80% of our developed websites are Magento websites. Never the less our perform More

$3225 USD in 30 days
(33 Reviews)

Hello Sir, I am from Confianza Technologies. I have gone through your requirements. We have developers who have vast experience in required technologies. We are interested in your project, but before finalizing budget More

$750 USD in 18 days
(40 Reviews)

Dear Sir, We claim to get it done perfectly for you EXACTLY in the way you want it - Kindly give we a chance and we will prove myself - Ready to prove our words, let's get it done right away and I mean RIGHT AWAY !! More

$568 USD in 7 days
(61 Reviews)

Hi, Its Steve. Ready for the task. I am expert in scraping. Have scraped lots of sites before. You can find some of them in my [url removed, login to view] see my reviews and previous projects. Have scraped sites that require login More

$506 USD in 7 days
(26 Reviews)

Hi sir, Thank you for giving opportunity for biding... we have gone through your requirements and we can build your Amazon web scraper module and import them into your Magento site according to your exact requireme More

$773 USD in 30 days
(26 Reviews)

Hi, I'll be happy to do that for you. I have rich experince in scrapping using curl regular expressions Dom and Selenium RC. I worked for [url removed, login to view] and [url removed, login to view] search engine where I gain my experience More

$257 USD in 3 days
(20 Reviews)

Hello Sir, We have checked your job detail and as per that we are able to do your job and we have very good experience in Word Press, Joomla, Joomla component, Modules, PHP, HTML,Magento etc . As well knowledge on More

$412 USD in 12 days
(22 Reviews)

Hi, Don't want to bother you with some standard approach or random portfolio, so I will be straight to the point. This is our portfolio: [url removed, login to view] And here is our MAGENTO certification member. htt More

$1102 USD in 14 days
(4 Reviews)

Hello, We have excellent team of programmers and designers to work on your project efficiently and complete job in time. We have read your deepest requirement at our best and will surely give better results. thanks

$257 USD in 10 days
(12 Reviews)

Hi, I have 5+ years of experience in amazon,i done lot of amazon jobs before,i done 5 tools recently for amazon, please check my amazon jobs in my profile one is amazon scraper it will scrape all products accordi More

$388 USD in 10 days
(2 Reviews)

Hello Sir, We've done a number of web scraping projects for our clients. We have scraped many directory websites and e-commerce websites including You can look at some sample data here: [url removed, login to view] More

$220 USD in 7 days
(3 Reviews)

Respected Sir, The following script lists items from amazon api by items asin and also gives facility to download items [url removed, login to view] [url removed, login to view] (Inp More

$222 USD in 3 days
(1 Review)

Hello Sir, We have a team of 50+ highly skilled employee .We will give you best result with in specified [url removed, login to view] give me few minutes for the technical discussion so we will get clear idea about your requiremen More

$206 USD in 3 days
(1 Review)

Good day! After reading the project description, i am confident that i can do this job. I hope you will consider me for this job and i can start immediately. Thanks

$206 USD in 4 days
(0 Reviews)

Dear Sir, I have read the job description of yours and the URL and ready to start work with you as i am having major expertise in Data scraping or web scarping and also with its related works. I am ready to show More

$263 USD in 3 days
(0 Reviews)

Dear Sir Hi, Greetings of the day and thanks for sharing these details and allowing me to bid on this assignment. yes we have similar experience and can deliver u as u have mentioned in your requirements. we More

$222 USD in 9 days
(0 Reviews)