Speed Up NFS to S3 Video Pipeline
Budget: $10 – $30 USD
I have a python script that copies video files from a NFS server, converts them with FFmpeg, and uploads them to S3. While this script works well, it's currently performing at a slow pace due to the bottleneck in the transfer speed between the NFS and the server.
To enhance efficiency, I need a talented Python developer who can refactor the script to handle the conversion of the first videos while still copying the second one, instead of waiting for all files to be copied before starting the conversion.
Key Requirements:
- Proficient in Python
- Experience with NFS servers
- Familiar with S3 uploads
- Knowledgeable in handling large video files (typically greater than 10GB)
The main goal is to speed up the video processing pipeline without compromising the quality of the conversion.
To enhance efficiency, I need a talented Python developer who can refactor the script to handle the conversion of the first videos while still copying the second one, instead of waiting for all files to be copied before starting the conversion.
Key Requirements:
- Proficient in Python
- Experience with NFS servers
- Familiar with S3 uploads
- Knowledgeable in handling large video files (typically greater than 10GB)
The main goal is to speed up the video processing pipeline without compromising the quality of the conversion.