Git-like version control for data lakes
Marquez
Open source lineage and metadata service from WeWork
About Marquez
An open source application for collecting, aggregating and visualising data ecosystem metadata, maintaining lineage of how data is produced and consumed across jobs and datasets. It is free and open source, so teams can self-host it, inspect the code and adapt it to their own infrastructure without licence fees or vendor lock-in. Typical users run it alongside existing workflows to cut manual effort, improve visibility and keep full control over data, configuration and upgrades over time.
Marquez key facts
- Category: Data & Analytics
- Pricing: Free — listed in this directory as a free tool, with no paid plan required to use it.
- Focus areas: lineage, metadata, visualisation, catalog
- Official site: marquezproject.ai
About the Data & Analytics category
Analytics and BI platforms that turn raw data into clear insights. The Data & Analytics category on Tools Hub currently lists 712 tools. Alongside Marquez, it includes LakeFS, Nessie, Pachyderm, Feast.
More in Data & Analytics
Comparing tools in the Data & Analytics category? These related listings are worth a look: LakeFS — Git-like version control for data lakes; Nessie — Transactional catalogue for data lakes with Git-like semantics; Pachyderm — Data versioning and pipelines for data science at scale.
Transactional catalogue for data lakes with Git-like semantics
Data versioning and pipelines for data science at scale
Open source feature store for machine learning
Distributed vector search engine for approximate nearest neighbours
Cloud-native distributed file system and object storage