AWS RDS MySQL Database Archiving Expert
Budget: $10 – $30 USD
Project Overview
We need a database specialist to help us implement an efficient archiving solution for our AWS RDS MySQL database. The goal is to archive older data from several related tables to archive tables while maintaining data integrity and minimizing downtime.
Current Situation
We have several interconnected MySQL tables that need archiving (packages, package_histories, cod_histories, rider_tasks, rider_packages)
Data volume: ~500K rows in packages table and ~1.5M rows in history tables
Current process:
We manually select rows, insert them into archive tables (x_{table_name}), then delete from source tables
Foreign key constraints are causing long deletion times
We have a specific deletion sequence:
package_histories → cod_histories → rider_packages → rider_tasks → packages
Project Requirements
Design and implement an efficient archiving solution for our MySQL database in AWS RDS
Create archive tables that maintain the same structure as source tables
Develop a process to transfer data older than 6 months to archive tables (data from July 2024 and newer should remain)
Ensure minimal downtime during the archiving process
Handle foreign key constraints efficiently to reduce deletion time
Document the entire process so our team can replicate it independently in the future
Provide recommendations for future archiving cycles
Deliverables
Complete archiving solution implementation
Step-by-step documentation of the archiving process
Performance analysis report comparing before and after archiving (optional, but would be happy if included)
Recommendations for future archiving cycles (optional)
We look forward to working with an experienced database specialist who can help us implement an efficient, repeatable archiving process.
We need a database specialist to help us implement an efficient archiving solution for our AWS RDS MySQL database. The goal is to archive older data from several related tables to archive tables while maintaining data integrity and minimizing downtime.
Current Situation
We have several interconnected MySQL tables that need archiving (packages, package_histories, cod_histories, rider_tasks, rider_packages)
Data volume: ~500K rows in packages table and ~1.5M rows in history tables
Current process:
We manually select rows, insert them into archive tables (x_{table_name}), then delete from source tables
Foreign key constraints are causing long deletion times
We have a specific deletion sequence:
package_histories → cod_histories → rider_packages → rider_tasks → packages
Project Requirements
Design and implement an efficient archiving solution for our MySQL database in AWS RDS
Create archive tables that maintain the same structure as source tables
Develop a process to transfer data older than 6 months to archive tables (data from July 2024 and newer should remain)
Ensure minimal downtime during the archiving process
Handle foreign key constraints efficiently to reduce deletion time
Document the entire process so our team can replicate it independently in the future
Provide recommendations for future archiving cycles
Deliverables
Complete archiving solution implementation
Step-by-step documentation of the archiving process
Performance analysis report comparing before and after archiving (optional, but would be happy if included)
Recommendations for future archiving cycles (optional)
We look forward to working with an experienced database specialist who can help us implement an efficient, repeatable archiving process.