Unified programming model for batch and streaming pipelines
Dask
Parallel computing library that scales Python workflows
About Dask
A flexible library for parallel computing in Python that scales familiar tools such as NumPy, pandas and scikit-learn to larger-than-memory datasets across clusters of machines. Its open development model means documentation, plugins and community support are publicly available, and organisations can contribute fixes upstream instead of waiting on a vendor roadmap. For many teams it becomes long-lived infrastructure: simple to back up, straightforward to automate and independent of per-seat pricing as usage grows steadily.
Dask key facts
- Category: Data & Analytics
- Pricing: Free — listed in this directory as a free tool, with no paid plan required to use it.
- Focus areas: parallel, python, dataframe, scaling
- Official site: dask.org
About the Data & Analytics category
Analytics and BI platforms that turn raw data into clear insights. The Data & Analytics category on Tools Hub currently lists 712 tools. Alongside Dask, it includes Apache Beam, Apache Storm, Bytewax, Faust.
More in Data & Analytics
Comparing tools in the Data & Analytics category? These related listings are worth a look: Apache Beam — Unified programming model for batch and streaming pipelines; Apache Storm — Distributed real-time computation system; Bytewax — Python stream processing framework for real-time applications.
Distributed real-time computation system
Python stream processing framework for real-time applications
Stream processing library built on Kafka Streams ideas
Streaming SQL database purpose-built for Kafka
Stream processing framework integrated with Kafka and YARN