VOOZH about

URL: https://thenewstack.io/what-does-it-take-to-manage-hundreds-of-kubernetes-clusters/

⇱ What Does It Take to Manage Hundreds of Kubernetes Clusters? - The New Stack


TNS
SUBSCRIBE
Join our community of software engineering leaders and aspirational developers. Always stay in-the-know by getting the most important news and exclusive content delivered fresh to your inbox to learn more about at-scale software development.
REQUIRED
It seems that you've previously unsubscribed from our newsletter in the past. Click the button below to open the re-subscribe form in a new tab. When you're done, simply close that tab and continue with this form to complete your subscription.
The New Stack does not sell your information or share it with unaffiliated third parties. By continuing, you agree to our Terms of Use and Privacy Policy.
Welcome and thank you for joining The New Stack community!
Please answer a few simple questions to help us deliver the news and resources you are interested in.
REQUIRED
REQUIRED
REQUIRED
REQUIRED
REQUIRED
Great to meet you!
Tell us a bit about your job so we can cover the topics you find most relevant.
REQUIRED
REQUIRED
REQUIRED
REQUIRED
REQUIRED
Welcome!

We’re so glad you’re here. You can expect all the best TNS content to arrive Monday through Friday to keep you on top of the news and at the top of your game.

What’s next?

Check your inbox for a confirmation email where you can adjust your preferences and even join additional groups.

Follow TNS on your favorite social media networks.

Become a TNS follower on LinkedIn.

Check out the latest featured and trending stories while you wait for your first TNS newsletter.

PREV
1 of 2
NEXT
VOXPOP
As a JavaScript developer, what non-React tools do you use most often?
Angular
0%
Astro
0%
Svelte
0%
Vue.js
0%
Other
0%
I only use React
0%
I don't use JavaScript
0%
Thanks for your opinion! Subscribe below to get the final results, published exclusively in our TNS Update newsletter:
NEW! Try Stackie AI
From clobbered drafts to real-time sync
Apr 14th 2026 10:00am, by David Moore
TypeScript 6.0 RC arrives as a bridge to a faster future
Mar 14th 2026 9:00am, by Darryl K. Taft
Mastra empowers web devs to build AI agents in TypeScript
Jan 28th 2026 11:00am, by Loraine Lawson
2022-01-28 08:13:04
What Does It Take to Manage Hundreds of Kubernetes Clusters?
contributed,sponsor-qovery,sponsored,sponsored-post-contributed,
Cloud Services / Kubernetes / Open Source

What Does It Take to Manage Hundreds of Kubernetes Clusters?

To automate the deployment of Kubernetes on AWS, Qovery has created an open source deployment engine written in Rust.
Jan 28th, 2022 8:13am by Romaric Philogène
👁 Featued image for: What Does It Take to Manage Hundreds of Kubernetes Clusters?
Feature image via Pixabay
Qovery sponsored this post.

Key Takeaways:

  • Deploying a production-ready Kubernetes cluster with all the required dependencies for going into production takes days.
  • Managing a float of Kubernetes clusters is very hard if you do not automate the process.
  • Managing a float of Kubernetes clusters across several cluster providers is even harder.
  • Upgrading a Kubernetes cluster requires intensive tests to make sure changes do not break anything. It’s not just pushing an “upgrade” button like often suggested.
Romaric Philogène
Romaric is CEO and co-founder of Qovery with more than 10 years of experience in site reliability engineering  and software development.

Managing one Kubernetes cluster is hard, but what about managing hundreds of Kubernetes clusters worldwide?

Hundreds of Kubernetes clusters with multiple nodes, services, applications and load balancers. This is what we do at Qovery; we manage hundreds of production Kubernetes clusters worldwide to help more than 16,000 developers deploy their apps on AWS.

But what does it take to run and manage hundreds of Kubernetes clusters? This is what I will share with you in this article.

Some Context

With Qovery, every user can get started to deploy their apps on AWS in a few seconds. The goal is to turn AWS into a smooth developer experience. Typically, our users come from Heroku and want to jump into AWS. They want to have the simplicity of Heroku and the flexibility of AWS. This is where using Qovery comes in.

To succeed in that path, Qovery uses EKS (AWS-managed Kubernetes) to run and scale stateless applications. Every single user has at least one or more Kubernetes clusters. The promise of Qovery is to get a prod-ready Kubernetes cluster, meaning the Kubernetes deployment, run and management is on us. The piece of software responsible to manage the clusters is called the Qovery Engine and is open source.

Deploying Prod-Ready Kubernetes Clusters

To automate the deployment of Kubernetes on AWS, we have created an open source deployment engine, an application written in Rust. Basically, it initializes the virtual private cloud (VPC) for Kubernetes, the ingress, the auto-scaler, Loki, S3 to store the Kubernetes logs and lastly Kubernetes. The Qovery engine uses Terraform, Helm and the AWS API. Curious to take a look? All the files are available here. It takes 30 minutes from zero to a prod-ready Kubernetes cluster on AWS instead of weeks.

👁 Image

The first time you use Qovery on an AWS account, a VPC and an EKS cluster are set up. Once fully set up, the Qovery Engine is installed and connects to the Qovery Control Plane to receive the application deployment instructions.

Running Kubernetes

Running and managing Kubernetes is simplified (no etcd, master nodes, network overlay to manage) since Qovery relies on the managed Kubernetes offer from AWS (EKS). AWS guarantees that the cluster is always operational by taking care of the master nodes responsible for the integrity of the complete cluster.

👁 Image

However, the added value of Qovery here is simplifying app deployment and making sure those apps are running correctly. All the information of those applications and the cluster itself are reported in real time to the user if something goes wrong. This is handled by the Qovery Engine and our Qovery Agent.

Keeping Kubernetes Up to Date

Every 10 weeks a new version of Kubernetes is released. At this pace, staying up to date is challenging. Especially when breaking changes happen. Testing the upgrade on a staging cluster before doing it in production is mandatory but requires a fair amount of time.

👁 Image

Even for us. At Qovery, a dedicated team is in charge of managing the upgrade of the Kubernetes clusters of our users. The good news is that once we have made it once, it works (almost) the same for every cluster.

👁 Image

For security reasons, the Qovery Engine connects to the Qovery Control Plane and pulls cluster update instructions. The Qovery Engine takes care of the rolling update on all the Kubernetes worker nodes with the newer version and the associated dependencies (Loki, ingresses, etc.). The Qovery Engine guarantees that the cluster is fully operational and ready to receive new app deployments.

Qovery helps more than 16000 developers to deploy their apps on AWS in just a few minutes. Qovery is the simplest way to deploy your apps on AWS. Get notable features like instant app deployment and preview environments on top of your AWS account.
Learn More
The latest from Qovery

Wrapping Up

In this article, we have seen how a float of hundreds of Kubernetes clusters is managed by the Qovery Engine, an open source library written in Rust. Deploying, running and updating a float of Kubernetes clusters takes a huge amount of time and needs to be automated to guarantee their uptime.

Qovery helps more than 16000 developers to deploy their apps on AWS in just a few minutes. Qovery is the simplest way to deploy your apps on AWS. Get notable features like instant app deployment and preview environments on top of your AWS account.
Learn More
The latest from Qovery
TRENDING STORIES
Romaric is CEO and co-founder of Qovery with more than 10 years of experience in site reliability engineering and software development.
Read more from Romaric Philogène
Qovery sponsored this post.
SHARE THIS STORY
TRENDING STORIES
TNS owner Insight Partners is an investor in: Pragma.
SHARE THIS STORY
TRENDING STORIES
TNS DAILY NEWSLETTER Receive a free roundup of the most recent TNS articles in your inbox each day.
The New Stack does not sell your information or share it with unaffiliated third parties. By continuing, you agree to our Terms of Use and Privacy Policy.