3 years ago

Category: Data, automation

The wide-scale adoption of data-streaming platform Apache Kafka can be reflected in the skyrocketing need for a data-management platform that can underpin data operations and needs across a number of sources, often at a global scale. According to a recent Gartner report “Understanding Cloud Data Management Architectures: Hybrid Cloud, Multicloud and Intercloud,” for example, almost half of all organizations with data-management operations manage data on on-premises and cloud environments (typically multicloud).

A mom-and-pop online retailer requires real-time data streaming for its supply chain spread across continents and for online data transaction storage and management.

Kafka serves as a “central nervous system” to connect disparate data sources, often located in different corners of the globe, As Ben Stopford, Confluent lead technologist for the office of the Chief Technology Officer; and Addison Huddy, Confluent group product manager, described in a blog post.

Without Kafka, “a big unintended consequence of all the hybrid multiclouds out there is in this effort to create these streams and break down the silos and pile the data together, you can actually end up often creating new data silos as you create different sets of data streams,” Dan Rosanova, head of product management for Confluent Cloud, told The New Stack.