treeverse / lakeFSLinks
lakeFS - Data version control for your data lake | Git for data
☆4,931Updated this week
Alternatives and similar repositories for lakeFS
Users that are interested in lakeFS are comparing it to the libraries listed below
Sorting:
- An Open Standard for lineage metadata collection☆2,156Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,668Updated 3 weeks ago
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,345Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,351Updated this week
- Querybook is a Big Data Querying UI, combining collocated table metadata and a simple notebook interface.☆2,190Updated last week
- Collect, aggregate, and visualize a data ecosystem's metadata☆2,036Updated 2 weeks ago
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆2,228Updated this week
- Apache Iceberg☆8,100Updated this week
- lakeFS airflow operator☆27Updated 2 years ago
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,191Updated last week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,530Updated last month
- Compare tables within or across databases☆2,990Updated last year
- Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.☆2,372Updated this week
- Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.☆6,146Updated last week
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆12,028Updated last week
- Real-time event streaming platform. Streaming CDC, stream processing, low-latency serving, and Iceberg management.☆8,442Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,116Updated 6 months ago
- re_data - fix data issues before your users & CEO would discover them 😊☆1,571Updated last year
- First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business…☆1,357Updated 8 months ago
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆5,562Updated this week
- An open protocol for secure data sharing☆882Updated this week
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆6,547Updated this week
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,686Updated this week
- Apache DataFusion SQL Query Engine☆7,902Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,870Updated last week
- Dremio - the missing link in modern data☆1,445Updated 3 weeks ago
- 🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, with Estuary Flow. 🌊☆834Updated this week
- Postgres-native columnar storage extension☆2,996Updated 8 months ago
- Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!☆11,138Updated this week
- Python Stream Processing☆1,869Updated 6 months ago