astronomer / airflow-llm-demo
☆13Updated last year
Alternatives and similar repositories for airflow-llm-demo:
Users that are interested in airflow-llm-demo are comparing it to the libraries listed below
- Cost Efficient Data Pipelines with DuckDB☆51Updated 8 months ago
- ☆11Updated 3 years ago
- Code snippets for Data Engineering Design Patterns book☆75Updated 2 weeks ago
- Make simple storing test results and visualisation of these in a BI dashboard☆43Updated 2 weeks ago
- Docker envinroment to stream data from Kafka to Iceberg tables☆26Updated last year
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆24Updated 11 months ago
- An LLM-powered chatbot with the added context of the dbt knowledge base.☆39Updated 4 months ago
- build dw with dbt☆43Updated 5 months ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset☆39Updated 4 months ago
- Delta Lake examples☆221Updated 5 months ago
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 8 months ago
- Full stack data engineering tools and infrastructure set-up☆50Updated 4 years ago
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆27Updated last year
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- Streamlit application to explore Snowflake Tables☆39Updated last year
- Query Iceberg in Trino, Nessie as Catalog, and use minio to replace AWS S3☆18Updated 10 months ago
- Terraform Provider for Airbyte API☆54Updated last week
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆66Updated 6 months ago
- Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market☆57Updated 2 years ago
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆32Updated last year
- A Snowflake GPT Demo using SqlAlchemy☆23Updated last year
- ☆73Updated 2 months ago
- Creates simple data models on Snowflake to report dbt source freshness and tests☆26Updated last year
- ☆9Updated last year
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆137Updated this week
- Library to convert DBT manifest metadata to Airflow tasks☆48Updated last year
- Example Dagster Cloud code for the Hooli Data Engineering organization.☆1Updated this week
- An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer☆222Updated 2 weeks ago
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆43Updated 2 years ago
- Analytics engineering with dbt - projects and developer environment☆18Updated 6 months ago