Scrape a website for products (Daily)

Completed Posted Apr 14, 2013 Paid on delivery
Completed Paid on delivery

Hi,

I'm looking for a professional programmer with experience in website scraping.

I need to have a script build, which can automatically scrape a website for products, on a daily/weekly basis and then automatically insert all the products in to my Magento store.

I need the following information to be scraped:

- Product Title

- Product Description

- Product Images

- SKU number

- Price (USD)

IMPORTANT - READ THIS:

(IMAGES)

The images shown on the site has a watermark, but if you change the image size from 250x250 to 500x500 in the address link, the watermark automatically gets removed, so the script needs to scrape all the images and then automatically replace the text 250x250 with 500x500 in the address link, to show the images without a watermark on my site.

Example:

[login to view URL] (With watermark)

[login to view URL] (Without watermark)

(PRODUCT DESCRIPTION)

I need the product description to be scraped in plain text, so any links to the original site should not be clickable.

(PRICE)

The site offer 3 different prices (shipped from different locations) so the script should automatically look for price #1 first, if this is not available, it should look for price #2 and last, price #3.

If all prices is available, it should scrape price #1 only.

(QUANTITY)

The quantity is not shown on the product page, but a warning message appears when the product is out of stock. So I need a function, which picks up this warning message and then automatically change the product quantity on my site to "0" (Out of stock)

Maybe there is an easier way to locate out of stock products and I'm open to suggestions.

I want the scraped products to be shown in specific categories on my site, so it should be possible for me to manually choose which categories the products goes in to. (The categories on my site, will not be similar to the categories on the original site)

Example:

I would like the products from category (Electronics) on the original site, to go to my site, in the (Computer) category.

I found this open source scraping tool, that you might find useful - [login to view URL]

I didn't post the name of the site that needs to be scraped, but if you have any questions or need to test out the site, please contact me and I will send you the URL of the site.

Thank you!

Data Entry Data Processing Web Scraping

Project ID: #4429267

About the project

33 proposals Remote project Active Apr 15, 2013

Awarded to:

Conderella

Kindly check PM

$139 USD in 3 days
(23 Reviews)
5.2

33 freelancers are bidding on average $181 for this job

mantislin

Hi sir, please check PM, thx Kimi.

$248 USD in 5 days
(479 Reviews)
8.3
gangabass

I'm web scraping expert that's why I'm sure you'll be satisfied with my work. See PMB for details.

$100 USD in 3 days
(563 Reviews)
8.0
phpXpertbd

Seasoned web scraper. I worked on many similar projects, I have big experience in data mining projects. I can finish this task in short time, with the best quality.

$220 USD in 3 days
(85 Reviews)
7.5
cheapexcell

Expert in web scraping. Ready to start

$225 USD in 5 days
(188 Reviews)
7.1
inzaghi2006

Hi, I'm very interested in your project. please contact me, Thanks

$210 USD in 4 days
(91 Reviews)
6.9
SigmaVisual

I can help in your project, please check PMB and our ratings/reviews to get idea of our experience. Please let me know if you have any queries.

$240 USD in 7 days
(71 Reviews)
7.0
sureshdevi

I can create a script to automatically download products information from a website and insert into magento website including images. I will complete this work in 2 days.

$150 USD in 2 days
(87 Reviews)
6.2
omaralieissa

Hi, i'm professional web scrapping programs coder, check my reviews please, and please send me your website so i can check it, thanks.

$150 USD in 3 days
(35 Reviews)
5.6
manageo

Hi, I can offer you the such service

$147 USD in 3 days
(50 Reviews)
5.3
proauthor

Hi, Ready to start your work. Eagerly awaiting for your positive reply. Please check your inbox for further details. Thanks, Shaik.

$139 USD in 3 days
(51 Reviews)
5.4
jitendraparmar07

Web scraping is my main profession. I've been scraping products and uploading onto magento for quite some time. Please check your PMB.

$200 USD in 5 days
(37 Reviews)
5.2
raul27868

Hello, I can do this work for you and I'm ready to start. Please see pmb for more details. Regards Raul

$200 USD in 7 days
(11 Reviews)
4.8
allhen

Ready to help you with this,

$600 USD in 5 days
(18 Reviews)
4.8
tuhindo82

Dear I have just seen your Job posting and upon reading thoroughly, I felt strongly that I would be the most qualified contractor for your project. I have vast experience in IT / Data Entry / Web Research /Admin / SE More

$250 USD in 25 days
(15 Reviews)
4.9
AndrwProjects

Hi. Experienced with Scraping and Magento import.

$250 USD in 12 days
(10 Reviews)
4.2
emreg

Scraper expert is here!

$80 USD in 1 day
(9 Reviews)
4.2
ramlak

I'm interested in doing this project. Let's start....

$250 USD in 25 days
(10 Reviews)
4.0
datavisualizer

Hi. I have experience scraping industry data from web sources in an enterprise environment outside of freelancer. Send me the URL to the website you want to scrape and I can provide you a demo.

$275 USD in 7 days
(9 Reviews)
3.6
netcoder

Hi, I think I can do it:-)! Best regards, netcoder:-)

$154 USD in 5 days
(7 Reviews)
3.3
debaphp

I have vast experience on magento scraping. Please check inbox.

$275 USD in 5 days
(3 Reviews)
2.8