Let's connect
Let's connect

Increased efficiency of Kubernetes scaling

1 minutes read

Our client, a Tel Aviv-based provider of cloud services, wanted to deliver to its customers a more efficient Kubernetes scaling. They were looking for a custom solution that could produce long-term cost savings without relying on allocating additional storage, memory or CPU. 

VirtusLab helped the client build and integrate a custom Kubernetes operator with built-in optimization features, such as an AI-driven system for storing cache. The client implemented this solution for multiple customers and noted an increased reaction time to traffic spikes, better security of AWS Spot instances and cost savings.

Download this success story as PDF

Print it out, take it with you to read later, or share it with your peers. Free download

The challenge

Our client aimed to increase the efficiency of their Kubernetes scaling services, especially during unexpected traffic spikes. Typically, this would require allocating additional resources like memory, storage, and CPU to the Kubernetes cluster, which comes with a risk of overprovisioning. The client was looking for an alternative solution that would also cut an instance creation time to 30 seconds or less.

VirtusLab designed and implemented a Kubernetes operator that steered clear of overprovisioning. The goal was to improve the efficiency and cost-effectiveness of Kubernetes scaling, especially when it involves hundreds of nodes.

The solution

VirtusLab adopted two key Kubernetes performance optimization techniques, namely hibernation and internal scaling, to make sure the operator works efficiently and saves money.

Additionally, VirtusLab has integrated distributed tracing powered by OpenTelemetry’s set of standards and tools. This combination will help the client with future maintenance and system monitoring.

To enhance the efficiency of scaling up in Kubernetes, VirtusLab implemented an intelligent, AI-driven system that stores and rapidly accesses recently used container images, maintaining their cache. By doing so, the system quickly accesses these resources without having to retrieve them from a more distant source every time.

The results

The client successfully deployed the completed Kubernetes operator for multiple customers. This decreased the time required to create a single instance from 60 to 22 seconds, without exceeding the limitations of Kubernetes and the AWS API. Additionally, the client observed:

  1. Reduced costs for each cluster
  2. Immediate response of cluster scaling to traffic surges
  3. Enhanced AWS Spot instance protection

The tech-stack

Programming language: Go

Platform: Kubernetes

Database: MongoDB

Cloud: Amazon Web Services (AWS)

Tooling: Various autoscaling products such as EKS Cluster AutoScaler, Karpenter and Spot.io, ContainerD and Docker, OpenTelemetry, DataDog, Prometheus, MongoDB

The tech-stack










Various autoscaling products such as EKS Cluster AutoScaler, Karpenter, Spot.io, ContainerD, OpenTelemetry, DataDog, and


Take the first step to a sustained competitive edge for your business

Let's connect

VirtusLab's work has met the mark several times over, and their latest project is no exception. The team is efficient, hard-working, and trustworthy. Customers can expect a proactive team that drives results.

Stephen Rooke
Stephen RookeDirector of Software Development @ Extreme Reach

VirtusLab's engineers are truly Strapi extensions experts. Their knowledge and expertise in the area of Strapi plugins gave us the opportunity to lift our multi-brand CMS implementation to a different level.

facile logo
Leonardo PoddaEngineering Manager @ Facile.it

VirtusLab has been an incredible partner since the early development of Scala 3, essential to a mature and stable Scala 3 ecosystem.

Martin OderskyHead of Programming Research Group @ EPFL

The VirtusLab team's in-depth knowledge, understanding, and experience of technology have been invaluable to us in developing our product. The team is professional and delivers on time – we greatly appreciated this efficiency when working with them.

Michael GrantDirector of Development @ Cyber Sec Company