minio / openlakeLinks
Build Data Lake using Open Source tools
☆116Updated 5 months ago
Alternatives and similar repositories for openlake
Users that are interested in openlake are comparing it to the libraries listed below
Sorting:
- Apache Hive Metastore as a Standalone server in Docker☆80Updated last year
- Open Control Plane for Tables in Data Lakehouse☆371Updated this week
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆171Updated 3 weeks ago
- Collection of assets used for various articles at https://blogs.min.io☆40Updated 7 months ago
- Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team …☆128Updated last week
- Auto-generated Diagrams from Airflow DAGs. 🔮 🪄☆352Updated this week
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆77Updated this week
- Data product portal created by Dataminded☆193Updated last week
- A curated list of awesome DataOps tools☆209Updated 3 months ago
- The Open-Source Enterprise Data Platform in a single Portal☆259Updated this week
- Repository of helm charts for deploying DataHub on a Kubernetes cluster☆196Updated last week
- ☆80Updated last year
- A portable Datamart and Business Intelligence suite built with Docker, Dagster, dbt, DuckDB and Superset☆251Updated last month
- Docker envinroment to stream data from Kafka to Iceberg tables☆30Updated last year
- Dockerized monitoring stack for Apache Airflow☆32Updated last year
- One framework to develop, deploy and operate data workflows with Python and SQL.☆467Updated last week
- Minimal example to run Trino, Minio, and Hive standalone metastore on docker☆54Updated 3 years ago
- A curated list of open source tools used in analytics platforms and data engineering ecosystem☆389Updated 7 months ago
- The platform that powers Airbyte. Please file issues in https://github.com/airbytehq/airbyte☆282Updated this week
- Apache Flink (Pyflink) and Related Projects☆41Updated 6 months ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆49Updated last year
- Terraform Provider for Airbyte API☆59Updated 4 months ago
- ODD Specification is a universal open standard for collecting metadata.☆144Updated last year
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆102Updated 2 years ago
- The NiFiKop NiFi Kubernetes operator makes it easy to run Apache NiFi on Kubernetes. Apache NiFI is a free, open-source solution that sup…☆188Updated last week
- A Python package to submit and manage Apache Spark applications on Kubernetes.☆44Updated 2 months ago
- Dremio Container Tools☆162Updated 2 months ago
- A plugin for Apache Airflow that allows you to edit DAGs in browser☆451Updated 2 weeks ago
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆32Updated last year
- New Generation Opensource Data Stack Demo☆449Updated 2 years ago