Apache Beam

Unified programming model for batch and streaming pipelines

About Apache Beam

An open source unified programming model for defining batch and streaming data processing pipelines, which can run on multiple execution engines such as Flink, Spark and Google Cloud Dataflow. It is free and open source, so teams can self-host it, inspect the code and adapt it to their own infrastructure without licence fees or vendor lock-in. Typical users run it alongside existing workflows to cut manual effort, improve visibility and keep full control over data, configuration and upgrades over time.

Apache Beam key facts

Category: Data & Analytics
Pricing: Free — listed in this directory as a free tool, with no paid plan required to use it.
Focus areas: pipelines, streaming, batch, model
Official site: beam.apache.org

About the Data & Analytics category

Analytics and BI platforms that turn raw data into clear insights. The Data & Analytics category on Tools Hub currently lists 712 tools. Alongside Apache Beam, it includes Apache Storm, Bytewax, Faust, kSQLDB.

FreeData & Analyticspipelinesstreamingbatchmodel

More in Data & Analytics

Comparing tools in the Data & Analytics category? These related listings are worth a look: Apache Storm — Distributed real-time computation system; Bytewax — Python stream processing framework for real-time applications; Faust — Stream processing library built on Kafka Streams ideas.