77% storage cost reduction without vendor lock-in

5 minutes read
case-study
ClientNDA
IndustryLogistics

Our client, a global freight forwarder, needed to optimize its storage usage and operational costs in their data-intensive application. They handled 84.54 million requests per month, describing shipments worldwide and containing thousands of lines that were hard to separate into smaller chunks. The forwarder migrated from CosmosDB to Azure storage with VirtusLab’s help and expertise. The migration resulted in a significant reduction in costs and storage space.

Download this success story as PDF

Print it out, take it with you to read later, or share it with your peers.Free download
case-study

The challenge

Due to time restrictions, large storage volume, and a limited vendor lock, the logistics company ran their operations on CosmosDB with MongoDB API. Although the CosmosDB storage solution worked well initially, the client experienced a slowly increasing number of issues with growing data volume. They encountered challenges such as unexpected costs, timeouts for full scan queries and even risk of data corruption due to the schema-less nature of the database. The forwarder commissioned VirtusLab to create a more efficient storage solution.

The solution

VirtusLab suggested switching from CosmoDB to Microsoft Azure Storage adopting Apache Avro format. This change helped solve storage challenges. Using Apache Avro in a way similar to how Kafka is managing data allowed the client-controlled evolution and compatibility testing of data by using schemas, which are templates defining the structure, format, and data types of stored and transmitted information. Instead of storing and sending schemas, they only sent values, reducing storage needs and expenses.

The results

Our client rid themselves of storage issues with VirtusLab’s help. They gained:

  • Modification and update of the data structure in an organized way
  • Storage reduction by 63%
  • Operational costs reduction by 77%
  • Vendor lock avoidance

The tech stack

Languages: Scala

Infrastructure: Azure ComosDB, Microsoft Azure

Framework: Kafka, Apache Avro, Confluent Cloud

The tech-stack

Languages

scala-logo

Infrastructure

Azure_CosmosDB
Azure-logo

Framework

Kafka-logo
Confluent_Logo

Take the first step to a sustained competitive edge for your business

Let's connect

VirtusLab's work has met the mark several times over, and their latest project is no exception. The team is efficient, hard-working, and trustworthy. Customers can expect a proactive team that drives results.

Stephen Rooke
Stephen RookeDirector of Software Development @ Extreme Reach

VirtusLab's engineers are truly Strapi extensions experts. Their knowledge and expertise in the area of Strapi plugins gave us the opportunity to lift our multi-brand CMS implementation to a different level.

facile logo
Leonardo PoddaEngineering Manager @ Facile.it

VirtusLab has been an incredible partner since the early development of Scala 3, essential to a mature and stable Scala 3 ecosystem.

Martin_Odersky
Martin OderskyHead of Programming Research Group @ EPFL

VirtusLab's strength is its knowledge of the latest trends and technologies for creating UIs and its ability to design complex applications. The VirtusLab team's in-depth knowledge, understanding, and experience of MIS systems have been invaluable to us in developing our product. The team is professional and delivers on time – we greatly appreciated this efficiency when working with them.

Michael_Grant
Michael GrantDirector of Development @ Cyber Sec Company