Sumo Logic expands Data Pipelines to filter telemetry before ingestion

Sumo Logic expands Data Pipelines to filter telemetry before ingestion

AI-generated editorial illustration; not a documentary photograph.

Sumo Logic has expanded its Data Pipelines service with controls that let customers filter, transform and reroute telemetry before it is ingested and stored. The company says the changes are intended to help security and operations teams manage rising observability and security-data costs.

Decisions before storage

The controls are built into Sumo Logic's platform rather than requiring a separate tool. Customers can preview the effect of a pipeline rule on a live stream before enabling it, including whether data will move to a lower-cost tier or to a destination outside Sumo Logic.

Sumo Logic says it ingests and analyzes close to seven exabytes of data each day for thousands of security and operations customers. The company argues that collecting everything and analyzing it later has become harder to justify as ingestion and storage costs rise, particularly as AI workloads increase the amount of telemetry being generated.

Automation with approval

A new assistant can generate pipeline rules, a task Sumo Logic says previously took hours. The service also flags anomalies and changes in incoming data formats as they appear. Recommendations about what to route, transform or discard still require a person to approve them.

The company linked the product expansion to a Gartner report published Sept. 2. Gartner reportedly said organizations are defaulting to ingesting operational data for later analysis, while high volumes of low-quality telemetry can also hinder generative AI and large language model workloads that rely on that data.

Planned additions

Sumo Logic said a visual, AI-assisted interface for shaping telemetry before it reaches the company's platform or a customer's cloud storage is planned for later this year. It is expected to include controls for cloud and edge sources. A later platform-neutral version is intended to manage data headed to other vendors' tools.

The company also outlined an OpenTelemetry-native management layer for collector configuration, monitoring and deployment in one console. Sumo Logic said this could remove the need to run additional agents, but the source describes the capability as planned rather than available.

Source: Sumo Logic expands Data Pipelines to cut observability and security data costs

Share this article
FacebookThreadsLinkedInX

Leave a Reply

Your email address will not be published. Required fields are marked *