Skip to main content

VirtusLab's ArticlesRSS

Data Engineering|May 20, 2024

How to build an LLM chatbot for your company’s information

As organizations grow in size, the volume of internal information swells exponentially. A LLM chatbot helps to find the information and streamline data distribution.

How_to_build_an_LLM_chatbot_for_your_companys_information_image-min.jpg
Data Engineering|Nov 24, 2023

What does data transformation enable data analysts to accomplish?

Read everything about data transformation encompassing SQL, GUI, Scala, and Python, to get clean and structured data for your decision-making process. We delve into the technology and which is best for what project.

What_does_data_transformation_enable_data_analysts_to_accomplish__image-min.jpg
Data Engineering|Sep 27, 2023

What is data mesh? Redefining data platform architecture

Data Mesh has been founded on four key principles that revolutionized data management. It focuses on decentralization, domain-oriented teams, data-as-a-product, self-serve platform, and federated governance.

What_is_data_mesh_Redefining_data_platform_architecture_image-min.jpg
Data Engineering|May 19, 2023

Large Language Models: How to use open source alternatives to ChatGPT for Scala documentation

Large Language Models can revolutionize how programmers seek assistance. We tested them on Scala documentation and present the results here.

Large Language Models: How to use open source alternatives to ChatGPT for Scala documentation image
Data Engineering|Apr 25, 2023

Unlock the power of your analytical data platform for data-driven decisions

Businesses become competitive, once they avoid guesswork, create an environment for data-driven decisions, and use data from analytics platforms in their operational use cases. This is how you can excel.

Unlock the power of your analytical data platform for data-driven decisions image
Data Engineering|Mar 23, 2023

Is Hadoop still relevant: Is it our future, or does it belong to the past?

As business needs and market trends change, Hadoop and cloud data platforms will evolve together. Will Hadoop remain a data solution companies rely on?

Is_Hadoop_still_relevant__Is_it_our_future,_or_does_it_belong_to_the_past_image-min.jpg
Data Engineering|Aug 20, 2021

Table schemas in data pipelines Spark: How to handle large, nested & growing ones

In this post, we describe how we built a pipeline for the type of “incoming data” situation, and how we came up with a good solution in the end.

cover_data