Calyptia Core 2.0 Tackles Fleet Management for Observability

Calyptia recently unveiled Calyptia Core 2.0, which includes a number of key updates to its flagship telemetry pipeline platform. New features include scores of additional processing actions for data in pipelines, an AI assistant that simplifies the user experience for specifying processing needs, and fleet management functionality for controlling processing agents at the edge.

Calyptia Core 2.0 was announced on Observability Day Europe during KubeCon+CloudNativeCon Europe. Observability is the facet of data management concerned with making the transmission of data from sources to backend targets (for analytics or applications) more cost-effective, efficient, and meaningful.

To that end, Calyptia’s new release is integral to its “strategy for our telemetry pipelines approach that optimizes and gives users control of data flowing through a central point, or remotely through a distributed fleet of agents,” commented Eduardo Silva, Calyptia CEO.

The release signifies some of the most important motions occurring in the contemporary data space. The fleet management capabilities coincide with the mounting importance of edge computing and the distributed data ecosystem, while the AI agent typifies the increasing capacity to communicate with data systems via natural language.

Fleet Management

The notion of telemetry pipelines is predicated on sending data from sources to targets while processing it between these endpoints to streamline transmissions. Some use cases involve centralizing data prior to sending it to targets via telemetry pipelines that transform it according to business needs. However, there are a number of applications, some of which involve low latency data, in which it’s increasingly viable to send data directly from the edge to targets. Calyptia 2.0 has enhanced features to support situations in which, “I have a couple of agents sitting on edge nodes collecting the data and sending data [directly] to the telemetry pipelines,” Silva said.

Prior to the latest release of the platform, Calyptia users had to write complicated, customized scripts to manage Fluent Bit agents at the edge to perform these duties. Calyptia Core 2.0 contains mechanisms that automate the installation and configuration of the agents required to initiate data transfers for edge deployments. Consequently, it’s now much easier for users to “segment a fleet of agents and integrate different types of telemetry pipelines for different needs of different teams, plus monitoring, plus performance improvement capabilities,” Silva noted.

Processing Functionality

The fleet management facets of Calyptia Core 2.0 expand its chief value proposition of decreasing the amount of data sent from sources to targets while improving its relevance to business objectives. The new transformations it has, which include methods for aggregating, redacting, enriching, and reducing data in flight, compound this value and are convincing on their own, too. Calyptia Core 2.0’s transformations and processing rules allow organizations to maximize the utility of the data transmitted, largely by reducing its size while boosting its usefulness.

According to Silva, “Some customers say that every event they have in a log is huge, but I only need a few fields of that message; I need 20 to 30 percent of that information. So, they go ahead and write a processing rule with our tool, which will treat that message to the state they need that is useful for them.”

The processing capacity of worthy telemetry pipeline solutions effectively whittles down the data that’s transmitted to reduce the amount of data that moves. This decrease in data movement leads to a similar decline in the costs of managing data while increasing the effectiveness of the data that is moved for applications or analytics.  Silva articulated another use case in which, “In the processing phase you can easily discard data. For example, everything that is a DevOps message that was created by a developer, don’t send it to Splunk in production.”

Less Is More

If users require a processing action that’s not already built into Calyptia Core 2.0’s, they can readily write it in a script for a degree of automation in the future. The platform also has an AI agent that’s helpful in this regard and enables “you to write in human text what you need to accomplish and the AI assistant is going to write the processor action for you,” Silva mentioned.

These developments, in addition to the newfound ease of controlling telemetry pipelines at the edge, help Calyptia further fulfill its mission of providing data observability. “Generating more data doesn’t correlate with more value,” Silva cautioned. “It’s the opposite. More data is more noise unless you have a strategy to control that data flow.”