System Administration for a Trading Firm / Implementing a backup tool in Python

The first project involves developing a small Python script for backing up files on NFS of a Linux based data science / trading platform. In case of good performance and possible physical proximity to Madrid or Budapest, there will be followup projects which go deeper in our infrastructure. Other than Python, knowledge of network architectures, VPN, Cisco, AWS, Atlassian tools is a plus.

This first task is about implementing a cron/rsync based backup framework for given directories (including a data folder and user homes). The backup should make it easy to access daily snapshots of the last 31 days, then weekly snapshots for the last 3 months, monthly snapshots for the last year, and finally yearly snapshots.


- The backup should be incremental, that is the same files in different snapshots should not be stored multiple times.

- The backup should be possible to browse on file/directory level directly on the file system without using additional tools.

- Restoring any subset of the data should be straightforward by copying.

The solution uses rsync and its linking support (see the --link-dest option in man rsync) to implement daily snapshots. Then we can use a Python script to erase old snapshots, only keeping the relevant ones (keeping recent daily snapshots, recent Mondays, recent 1st of months and all 1st snapshots of the year).

A good resource on using rsync for this purpose:

- [url removed, login to view]

The resulted tool will probably be open-sourced.

Skills: Linux, Network Administration, Python, Software Architecture

See more: python system administration, python for unix and linux system administration, python for system administration, python for system administrators tutorial, linux system administration with python udemy, python scripts for linux system administration pdf, python for unix and linux system administration pdf, python for unix and linux system administration epub, python linux administration scripts, python for windows system administration, python unix administration scripts, linux, script install, shell script, system admin, python system administration script, linux plesk system administration, freelancer system administration freebsd cisco, freelancer system administration, backup tool sftp server free

About the Employer:
( 0 reviews ) Chandigarh, India

Project ID: #16528742

5 freelancers are bidding on average €15/hour for this job

€16 EUR / hour
(44 Reviews)

**AWS EXPERT(5+ years Experience)*** I have already developed a GPS system earlier. Give me a chance if I can be assistance to you. I am cloud service expert, have a rich experience of Network and Security Servic More

€16 EUR / hour
(8 Reviews)

Hello, Hope you are doing well. I have good expereince on Backup server setup. If you need a GUI for accessing and Management, There are some Opensource applications are there , I can setup that. If you don More

€16 EUR / hour
(40 Reviews)

We will deliver the work in few days. We are starting here in, so we are bidding on this project mainly because we need good reviews. This a great opportunity to get your work done cheap, fast and with q More

€13 EUR / hour
(4 Reviews)

I have 6 year experience Freelancer,up work,Fiverr & 99design market place I have seen your project that i can to do easily because I have many experience to Graphic Design,Webdesign,Web Develop & programming .So I cou More

€16 EUR / hour
(0 Reviews)