Parts Centre Database Builder


We require a script that can be regularly executed as a server cron process to build a comprehensive, accurate hierarchical taxonomy of parts products (Part) from the following URL (Source Site):

[url removed, login to view]

Key requirements for the script:

Ideally PHP. Otherwise, in order of preference: [url removed, login to view], Python, Ruby.

- It must create, rename, update, and delete Parts and Elements.

- It must provide the following details about each Element/Part:

System Id

Part Reference


UI (where appropriate either image or image + coordinates)

- It must create a MySQL database with a fully normalised schema.

- It must email notifications (success,error) with details of process execution.

- It must not make too many concurrent requests to the Source Site.

- It must complete within a reasonable timeframe.

- It must reliably execute (<1% failure rate); consider handling of transient HTTP error codes

Preferences for the script:

- It should run with a minimum memory and CPU footprint.

- It should be resilient to changes in the underlying structure of the source site.


Skills: Data Mining, node.js, PHP, Ruby

See more: underlying data structure, schema update, process data structure, node data structure, key data structure, js products, data structure node, data mining process, node mysql, parts, make parts, ktm, image mining, database ui, database mining, data elements products, CENTRE, update data python script, php image cron, image coordinates python, minimum footprint server, rename url, create schema mysql, cron database schema, mysql create schema

Project ID: #5331087

Awarded to:


Hi, I have gone through your requirements twice and played a bit with I will create a PHP class using CURL library which will fetch thee products from that web site as if any human is More

£555 GBP in 10 days
(112 Reviews)

14 freelancers are bidding on average £607 for this job


1. Crowd Funding Site In these days we are already near to finish a full CMS based crowd funding site which is a clone of kickstarter but we implemented many unique features in this project to distinguish it from kic More

£747 GBP in 22 days
(87 Reviews)

Hello Sri Technocrat will provide fully interactive application/website for your project. As per the detail, Sri Technocrat will provide three template functional schemes and sample pages to make your choice for lay More

£684 GBP in 30 days
(51 Reviews)

Dear Customer! I am an expert PHP developer with over 6 years of experience and very interested to work on this project. Available to start immediately and finish as soon as possible. My bid is for fast professional s More

£515 GBP in 10 days
(163 Reviews)

Hello Sir, I am from Confianza Technologies. I have gone through your requirements. We have developers who have vast experience in required technologies. We are interested in your project, but before finalizing budget More

£750 GBP in 21 days
(41 Reviews)

hi, my bid is to do it in any of the 4 languages you specified node.js,php,python or ruby as i am expert in any of them. thanks Sherif

£824 GBP in 10 days
(81 Reviews)

I am highly interested in this project and will help you achieve results above and beyond you expectation with a quick turnaround...Hope to achieve next positive feedback from you!!! Please check you inbox for more inf More

£565 GBP in 12 days
(62 Reviews)

Hi, Hope you are doing well! We have gone through your requirement and we understand that you are looking for highly skilled, qualified, and experience Python development team for your project. Our developer More

£773 GBP in 15 days
(2 Reviews)

Hi, I can do this and can explain you in bit more how i would do this if you choose me for this task to complete with great completion on budget and time.I am an Expert Developer and having 8+years of Experience wit More

£515 GBP in 10 days
(4 Reviews)

Hello sir,  I have seen your requirement of the project and can do the mentioned requirement with good efforts and 100% completion with good quality and on time completion. Website Implementation Done :  ------- More

£410 GBP in 23 days
(4 Reviews)

Hi, I read and understood your problem. I'm an expert in server-side javascript and I can make the script in Node.js for you. Thanks in advance for considering me.

£444 GBP in 10 days
(3 Reviews)

A proposal has not yet been provided

£555 GBP in 10 days
(0 Reviews)

hello sir, this is soumain i have exp of more than 3 yrs in developing and implementing e-commerce,php,magento,node.js,mongodb,mysql and wordpress websites i also have exp of html5,puth@n,ruby and web design More

£666 GBP in 14 days
(0 Reviews)

I am a great fan of NodeJS ecosystem. All my new production is built in Node with ExpressJS. My code is clean an well structured. I build extendable apps so if you want to improve it later this wont be a problem. I am More

£500 GBP in 10 days
(0 Reviews)