In Progress

Web Scraper PHP Script

we are looking for web scraper php script

which will scan web sites products, get the data and then insert and update it into a MySql DB.

The scraper shall do the following steps, once a day as a cron job:

1. Scan the site and prepare a list of all his products name or SKUs.

2. Compare the list with existing DB.

3. Adding new products to the DB.

4. Download all product pictures into one directory when each picture name based on the SKU number and the picture number.

5. Update DB fields that had been changed for each existing product.

6. Translate all text fields with Google translator to six languages and add translation to the DB.

7. Changing the IP or the Proxy server in daily basses, in order to avoid blocking from scanned site administrator.

8. Generating Category code for each new category.

The DB should contain the following fields:

Category name

category code

category parent code

Product Title

SKU

Price (USD)

Quantity

Shipping costs (free shipping or not)

Overview \ Description (Text)

Specification

Dimensions

Shipping Weight

Related products list

Status (in stock, out of stock)

Delivery time (how many days to delivery, if maintained by the site)

Product original web page link

Added to DB Date/Time

Updated changes in the DB Date/Time

Number of total Small pictures

Number of total Large pictures

Small size pictures path

Large size pictures path

All pictures shall be added to a directory when each picture has name based on SKU and picture number.

the script will be executed on the following sites:

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view] - only free shipping products

[url removed, login to view]

[url removed, login to view] - only free shipping products,

Each site should be a different script file so it can be easy to add and remove scanned sites.

Skills: Data Processing, MySQL, PHP, Web Scraping

See more: web scraper data php script, sku script scraper, we do web sites, web server languages, web proxy free, web proxy directory, web page translation job, web languages list, web based languages, usd 305, translator price, translator job sites, translator job looking for, translator job list, translator job free, translation stock, translation proxy, translate get by, script php proxy web, proxy directory list, php free download, php free code, looking for job as translator, looking for job as a translator, looking for a translator of a web page

About the Employer:
( 4 reviews ) pardes hana, Israel

Project ID: #714610

12 freelancers are bidding on average $483 for this job

perlomonster

Please see the PMB!

$750 USD in 5 days
(53 Reviews)
6.4
shuvrapintu

hi, please check PMB.

$700 USD in 20 days
(116 Reviews)
6.4
Askali

More details provided via private message

$650 USD in 4 days
(10 Reviews)
6.0
ykm

Please see my pm.

$350 USD in 20 days
(9 Reviews)
4.0
markogh

Hi. I can get this done for you quickly and accurately. Please see PM. Thanks. -Mark

$300 USD in 5 days
(2 Reviews)
3.7
mvweb

ready to start

$250 USD in 5 days
(2 Reviews)
2.8
samuelhr

My name is Samuel Ryan and I'm a freelance Web Developer from England, I'm vastly experienced with data mining from other websites. I've checked out the websites you mentioned and they're all definitely workable. I can More

$500 USD in 5 days
(1 Review)
2.4
webdesigner95

I am ready to do this and deliver the script according to ur requirements.

$350 USD in 8 days
(3 Reviews)
2.2
alptechsolution

Hi, I have done similar jobs. See PM for demo of [url removed, login to view] Waiting for reply. Thanks

$250 USD in 1 day
(1 Review)
1.9
mbeermann

I work with symfony every day (which is perfect for quickly building this database). I'd like two weeks to do it because I want to make sure that you get a top quality and maintainable system (since websites that are s More

$600 USD in 14 days
(0 Reviews)
0.0
simkidakaka

Hello, please check your PMB. Thank you

$500 USD in 5 days
(0 Reviews)
0.0
softcoder99

please check PMB.

$700 USD in 15 days
(0 Reviews)
0.0
vsoft007

Please see my PMB.

$250 USD in 10 days
(0 Reviews)
0.0
bodaragama

I can do this project and i have done a lot of scan scripts for [url removed, login to view] I am a 15 years programmer and since 2002 with PHP check [url removed, login to view] and [url removed, login to view] And your translation with google i More

$750 USD in 30 days
(0 Reviews)
0.0