We wish to upload stock from a MS SQL Server 2008 Database (on WIndows Server) to our magento website (hosted on a separate remote linux server) automatically on a periodic basis using the fastest practicable means without risking the security of our data. The number of products involved is initially around 30,000 but this could rise significantly in the future (hence the need for speed). Our old SOAP interface is far too slow. Under normal operating circumstances, the system will be expected to transfer & upload all changed records every 15 minutes or so (normally < 20 recs). However, in the event of a recovery situation, we will upload all products in one go. Error handling will need to be built-in to ensure that read/write clashes and timing issues do not occur, failed transmissions are re-tried (eg 3 times) and user alerts/emails are sent out. Our internet link between the two servers is slow, so the solution should include the minimum number of separate communications between the two.
There are two aspects to this work:-
1) Creating the flat upload table and support tables (eg locking table, failed record transmissions, etc) in SQL Server ready to transmit to MySQL on the Linux box - THis is a separate work package but please feel free to quote for this if you can do this aspect too. For info, each product record contains either one or two top-level categories each with a sub-category. Each product also has up to 15 attributes.
2) Create an equivalent flat upload table in MySQL on the Linux box
3) Create scripts to extract the data from the SQL Server flat upload table and transmit to MySQL tables on the Linux box using a safe/secure method.
4) Create a script to upload our products from MySQL tables into Magento.
NB. Other solutions are not excluded.
Please quote for items 1-4 or 2-4.
Please could you also let me know the approximate time that you would expect your solution to take to transmit and upload 100K records. Also, please can you advise your earliest availability/start date
Due to some requests, I have attached further requirements and preliminary design information. I hope this helps.
Please note that other deigns will be considered as long as they are just as secure, just as fast and no more expensive.
10 freelancers are bidding on average £662 for this job
Hi We are web technology company and we feel pleasure to assist you on your project for more detail please see your PMB. Thank you Kind Regards John Steve