Optimize MySQL Performance on Proxmox VM to Match DigitalOcean’s Speed
Budget: $30 – $250 USD
i need to boost MySQL performance on my Proxmox VM to get query times as fast as DigitalOcean Managed MySQL. Here’s my setup:
Proxmox VM: Runs on a Hetzner server with 128GB RAM, NVMe SSD (913 MB/s), and 96 CPUs.
MySQL Settings: innodb_buffer_pool_size = 100G, innodb_parallel_read_threads = 32, innodb_io_capacity = 50000, plus other tweaks for speed.
Database: with a table called activity_log that has 111 million rows.
Problem: Running SELECT COUNT(*) FROM activity_log; takes 7.8 seconds on my VM, but only 2.5 seconds on DigitalOcean.
Goal: Get the COUNT(*) query down to under 3 seconds, like DigitalOcean.
Issues:
running the same query with the same data in my server (7.8sec) and on digitalocean managed database (2.5sec) (with practically same server config)
Optimize MySQL to use my hardware better.
Outcome I Want:
COUNT(*) query under 3 seconds.
MySQL fully using CPU and RAM efficiently.
Skills Needed:
Proxmox VM tuning.
MySQL optimization for big databases.
Knowledge of virtualization slowdowns and how to fix them.
If you can solve this let me know
Proxmox VM: Runs on a Hetzner server with 128GB RAM, NVMe SSD (913 MB/s), and 96 CPUs.
MySQL Settings: innodb_buffer_pool_size = 100G, innodb_parallel_read_threads = 32, innodb_io_capacity = 50000, plus other tweaks for speed.
Database: with a table called activity_log that has 111 million rows.
Problem: Running SELECT COUNT(*) FROM activity_log; takes 7.8 seconds on my VM, but only 2.5 seconds on DigitalOcean.
Goal: Get the COUNT(*) query down to under 3 seconds, like DigitalOcean.
Issues:
running the same query with the same data in my server (7.8sec) and on digitalocean managed database (2.5sec) (with practically same server config)
Optimize MySQL to use my hardware better.
Outcome I Want:
COUNT(*) query under 3 seconds.
MySQL fully using CPU and RAM efficiently.
Skills Needed:
Proxmox VM tuning.
MySQL optimization for big databases.
Knowledge of virtualization slowdowns and how to fix them.
If you can solve this let me know