I need a program, in perl or any other Linux shell language, that will scrape a remote website and take all the products and info about them, and put them into a mysql database that is pre-organized, possibly OS Commerce 3.0.
Need also a script to control the margin based on the category of the products, before inserting the 'price' into the online table.
The script should also handle the modifications of the remote data; such as images, descriptions, connected products, etcetera.
The script should also have a way of letting the user handle price variations on the original website.
A link to the website:
[login to view URL]
This is not the actual site; the real site will be same structure and everything, the only difference will be that it will be behind user/pass post authentication