Apache Airflow advanced functionalities examples
☆21Mar 22, 2024Updated last year
Alternatives and similar repositories for advanced-airflow
Users that are interested in advanced-airflow are comparing it to the libraries listed below
Sorting:
- A demonstration of an ELT (Extract, Load, Transform) pipeline☆31Feb 19, 2024Updated 2 years ago
- This repository contains an end-to-end data engineering project using Apache Flink, focused on performing sales analytics. The project de…☆11Nov 18, 2023Updated 2 years ago
- End-to-end data pipeline that ingests, processes, and stores data. It uses Apache Airflow to schedule scripts that fetch data from an API…☆21Jul 26, 2024Updated last year
- This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…☆45Dec 11, 2023Updated 2 years ago
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆31Apr 13, 2023Updated 2 years ago
- Repository for the dbt Semantic Layer course☆12Updated this week
- Beyond Vibe Coding. Code, Planning, Documentation and Product Management agents.☆70Feb 20, 2026Updated 2 weeks ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆30Updated this week
- This project shows how to capture changes from postgres database and stream them into kafka☆41May 17, 2024Updated last year
- ☆47Feb 23, 2021Updated 5 years ago
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆13May 24, 2024Updated last year
- ☆10Jun 30, 2022Updated 3 years ago
- ☆16Nov 17, 2017Updated 8 years ago
- DBT and clickhouse test project with dagster☆12Aug 29, 2023Updated 2 years ago
- This project showcases how to integrate the world of DevOps, focusing on Continuous Integration (CI) and Continuous Deployment (CD) with …☆15Dec 27, 2023Updated 2 years ago
- ☆13Feb 26, 2024Updated 2 years ago
- This project sets up a real-time data pipeline utilizing Change Data Capture (CDC) to stream changes from a PostgreSQL database to a Clic…☆12May 9, 2024Updated last year
- This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…☆43Jan 4, 2024Updated 2 years ago
- Generate custom Mac OS folder icons with a desired image as stamp☆12Oct 3, 2023Updated 2 years ago
- A Mermaid widget for interactively exploring Mermaid diagrams in notebooks and Panel data apps☆12Oct 25, 2024Updated last year
- dbt-databend adapter plugin☆10May 30, 2024Updated last year
- Generates a tree of an S3 bucket contents☆10Sep 18, 2020Updated 5 years ago
- End-to-End ELT data pipeline with Postgres, Airbyte, dbt, Dagster, Snowflake and Metabase☆11Jul 13, 2023Updated 2 years ago
- Building a poor man's data lake: Exploring the Power of Polars and Delta Lake☆11Dec 6, 2025Updated 3 months ago
- Collection of description of concepts, procedures, and simple XSLT files for text processing, e.g. simplify InDesign documents (.idml) to…☆12Jan 9, 2020Updated 6 years ago
- A Pytorch Dataloader for tif image files that dynamically crops the image.☆13Aug 21, 2020Updated 5 years ago
- Python utilities for BigQuery analyses.☆15Dec 10, 2020Updated 5 years ago
- Rust And Delta Demo. Explanation and walkthrough on delta-rs☆10Aug 21, 2023Updated 2 years ago
- ☆15Mar 31, 2022Updated 3 years ago
- Apache Cassandra Cluster with docker compose☆12May 17, 2024Updated last year
- Big data projects☆12Dec 10, 2018Updated 7 years ago
- It is a assemble to include all Practice Projects about Big Data Topic, includes Hadoop, Spark, Spark Streaming and Kafka☆11Mar 7, 2019Updated 6 years ago
- Trying out the Dataframe Polars library with Delta Lake ... feat Python.☆12Jan 29, 2025Updated last year
- This construct builds some elements for you to quickly launch an EMR Serverless application. After submitting the Emr Serverless job, you…☆11Nov 18, 2025Updated 3 months ago
- TTS utility☆12Aug 2, 2020Updated 5 years ago
- Cutting-edge, opinionated, and ambitious project builder for power users and researchers.☆15Feb 2, 2026Updated last month
- Examples from Rob's Awesome Python Template☆14Updated this week
- ☆12Sep 23, 2023Updated 2 years ago
- Serverless costs calculator for AWS Lambda☆12Oct 21, 2020Updated 5 years ago