dipankarmazumdar / awesome-lakehouse-guide
Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
☆30Updated 3 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for awesome-lakehouse-guide
- A Table format agnostic data sharing framework☆38Updated 9 months ago
- ☆26Updated 7 months ago
- Yet Another (Spark) ETL Framework☆18Updated last year
- Delta Lake Documentation☆46Updated 5 months ago
- A Python Library to support running data quality rules while the spark job is running⚡☆163Updated last week
- Flowchart for debugging Spark applications☆101Updated last month
- ☆49Updated 8 months ago
- Code snippets for Data Engineering Design Patterns book☆40Updated this week
- Library to convert DBT manifest metadata to Airflow tasks☆46Updated 8 months ago
- Code snippets used in demos recorded for the blog.☆29Updated last month
- 📚 Tech blogs & talks by companies that run Apache Flink in production☆156Updated last week
- Delta Lake helper methods. No Spark dependency.☆22Updated 2 months ago
- Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.☆149Updated 2 weeks ago
- The Internals of Spark on Kubernetes☆70Updated 2 years ago
- Performance Observability for Apache Spark☆198Updated last week
- Adapter for dbt that executes dbt pipelines on Apache Flink☆84Updated 8 months ago
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆61Updated this week
- Delta lake and filesystem helper methods☆49Updated 8 months ago
- Unity Catalog UI☆39Updated 2 months ago
- Spark style guide☆256Updated last month
- Don't Panic. This guide will help you when it feels like the end of the world.☆21Updated 5 months ago
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆189Updated this week
- The Internals of Delta Lake☆183Updated last month
- Quick Guides from Dremio on Several topics☆65Updated 3 weeks ago
- Delta Lake examples☆208Updated last month
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆85Updated 7 months ago