Completed

Python File Processor and Transfer Script - Needs fixing.

I have an almost finished mostly working script written by a colleague who has now left the company, it was written in Python which I know virtually nothing about.

It is designed to FTP into a pair of servers, retrieve a list of zip files ( which are updated weekly) , download the entire lot, unzip them on my server, then connect to my database, process the XML files to remove certain nodes and insert the required nodes into the database, once this is done a folder of images is processed to add non-duplicate images to a folder which are then uploaded to a bucket on S3.

There are 2 servers that this script needs to FTP into, and 2 sets of tables on the DB and 2 separate buckets for the images, I have the script working great for one server, it finishes properly and sends me an email, but when I try to run it on the second server it fails on upload to s3 and this kills the DB update process too. but it gets as far as downloading the content and unzipping it on my server. So I can see where the script is falling over, I just can't get why.

My Python guy was super fast and I honestly think this should be an hours or twos work for a python expert no more than that.

I have a repo all set which can be branched and I can give you the log in details, I can give you all the help you require.

Be aware you will be dealing with private data here and I will need you to sign a disclosure agreement, plus the files are large so there is no room for trial and error.

If you are interested in taking a look at the files please contact me.

Sorry my skills were listed wrongly before, there is no PHP required for this project.
This project is written in PYTHON ONLY and uses the BOTO library for unzipping and AWS transfer.

Skills: Amazon Web Services, C Programming, Python, Software Architecture, Web Hosting

See more: why are you interested in working here, where can i get python help, where can i get python, python, unzip ftp, s3 processor, python look for file, non disclosure agreement for software company, list get python, ftp unzip, file processor, database processor, s3 database, python download file, download file python, xml database expert, python: get data, python ftp, python expert, update data python script

About the Employer:
( 6 reviews ) Ashford, United Kingdom

Project ID: #7015503

Awarded to:

anuyadav1

A proposal has not yet been provided

£100 GBP in 1 day
(52 Reviews)
5.7

13 freelancers are bidding on average £141 for this job

hbxfnzwpf

I am very proficient in c, c++ and python. I have 7 years python developing experience now, and I have worked for 5 years. My work is online game developing, and mainly focus on server side, the language is c++ under l More

£130 GBP in 3 days
(49 Reviews)
6.0
iticus

Hello, I'm using Python daily for most of my programming needs. I have experience with lots of Python programming aspects: network applications, file manipulation, multiprocessing & multithreading, asynchronous lib More

£150 GBP in 2 days
(7 Reviews)
4.6
letshappy

hello, i am more then 4 year experience in this field i easily can do this task ready to start now thanks

£210 GBP in 4 days
(10 Reviews)
4.4
dsrrathor

A proposal has not yet been provided

£166 GBP in 0 days
(8 Reviews)
3.6
debjyoti7999

Day! I am PHP WORDPRESS DEVELOPER. I have read your project requirements very carefGood ully and look forward to further work opportunity on your project. Pricing will be $222 for this project. I have an excellent We More

£222 GBP in 5 days
(1 Review)
2.9
zhsoftstudio

Hello, I am an experienced C/C++ and Python programmer. Ready to help you with Python script. Please send me details and log file. Best regards, Volodymyr

£150 GBP in 3 days
(1 Review)
2.7
payal4668

A proposal has not yet been provided

£150 GBP in 3 days
(0 Reviews)
0.0
dustinblackman

I currently work in mass processing XMLs in to databases such as MySQL and Mongo, this would be nice and easy for me to fix. I'm sure we can work well together to get your problem solved. :)

£161 GBP in 3 days
(0 Reviews)
0.0
nishantsvv

A proposal has not yet been provided

£150 GBP in 5 days
(0 Reviews)
0.0
lukejenx

Python whizz kid, worked with all libraries I assume your colleague used. Recently been working on some scripts like this. Am happy to start working on this over the weekend or earlier. I am at my work between 9-5 U More

£150 GBP in 1 day
(0 Reviews)
0.0
rombr

Hello, I have experience with Python and AWS over 5 years. I like to create new and useful things I will be glad to help you. It is good that you can give logs!

£111 GBP in 1 day
(0 Reviews)
0.0
lakshmipathig

So this is basically debugging stuff? the script works with one server but not with another. Seems like you are good with python too. Did you try to use pdb module ? Does didn't help you? If you want , I can give it a More

£111 GBP in 1 day
(0 Reviews)
0.0
cloudystreams

Hi, I'm a senior Python developer with years of rich experiences. I'm interested in your project. I will do a perfact work for you. Please check my porfolio and work history for more details about me. Please give mor More

£100 GBP in 3 days
(1 Review)
1.8