minio / openlakeLinks
Build Data Lake using Open Source tools
☆119Updated 7 months ago
Alternatives and similar repositories for openlake
Users that are interested in openlake are comparing it to the libraries listed below
Sorting:
- Open Control Plane for Tables in Data Lakehouse☆377Updated this week
- Apache Hive Metastore as a Standalone server in Docker☆80Updated last year
- Docker envinroment to stream data from Kafka to Iceberg tables☆30Updated last year
- Collection of assets used for various articles at https://blogs.min.io☆41Updated 9 months ago
- The platform that powers Airbyte. Please file issues in https://github.com/airbytehq/airbyte☆292Updated last week
- Repository of helm charts for deploying DataHub on a Kubernetes cluster☆201Updated last week
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆103Updated 2 years ago
- Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team …☆130Updated 2 months ago
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆178Updated this week
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆78Updated last week
- Sparglim✨ makes PySpark App Configurable and Deploy Spark Connect Server Easier!☆41Updated last month
- Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)☆64Updated 2 years ago
- A curated list of open source tools used in analytics platforms and data engineering ecosystem☆422Updated 9 months ago
- The Open-Source Enterprise Data Platform in a single Portal☆263Updated this week
- New Generation Opensource Data Stack Demo☆454Updated 2 years ago
- Operator for Apache Spark-on-Kubernetes for Stackable Data Platform☆68Updated this week
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆76Updated 4 years ago
- ODD Specification is a universal open standard for collecting metadata.☆145Updated last year
- Auto-generated Diagrams from Airflow DAGs. 🔮 🪄☆354Updated last week
- Presto Trino with Apache Hive Postgres metastore☆43Updated last year
- ☆268Updated last year
- Data Product Portal created by Dataminded☆197Updated this week
- A Python package to submit and manage Apache Spark applications on Kubernetes.☆46Updated 5 months ago
- One framework to develop, deploy and operate data workflows with Python and SQL.☆474Updated last month
- A playground to experience Gravitino☆68Updated 2 weeks ago
- Dockerized monitoring stack for Apache Airflow☆35Updated last year
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆44Updated last year
- A curated list of awesome DataOps tools☆218Updated last month
- The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)☆252Updated 3 weeks ago
- ☆80Updated 2 years ago