anilkulkarni87 / airflow-docker

Related projects: ⓘ

• jmeisele / ml-ops-kafka
  Kafka variant of the MLOps Level 1 stack
  ☆22Updated 2 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆42Updated last year
• karenbajador / pyspark_greatexpectations
  ☆11Updated 2 years ago
• jacob1421 / RustCheatersDataPipeline
  Data pipeline that scrapes Rust cheater Steam profiles
  ☆50Updated 2 years ago
• datamechanics / examples
  ☆38Updated this week
• rodrigo-arenas / kafkaml-anomaly-detection
  Project for real-time anomaly detection using Kafka and python
  ☆55Updated last year
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆27Updated this week
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆47Updated last month
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆89Updated 2 years ago
• josephmachado / online_store
  End to end data engineering project
  ☆49Updated last year
• shravan-kuchkula / udacity-data-eng-proj3
  Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.
  ☆27Updated last year
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆26Updated last month
• sspaeti-com / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆38Updated 3 years ago
• astronomer / airflow-covid-data
  Sample Airflow DAGs to load data from the CovidTracking API to Snowflake via an AWS S3 intermediary.
  ☆16Updated 3 years ago
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆54Updated last year
• delta-io / delta-docs
  Delta Lake Documentation
  ☆45Updated 3 months ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆35Updated 2 months ago
• jw-ng / airflow-dynamic-dags
  ☆13Updated 2 years ago
• alonsomedo / os-data-stack
  Building a Data Pipeline with an Open Source Stack
  ☆36Updated 2 months ago
• Pathairush / rdbms_to_hdfs_data_pipeline
  A data pipeline moving data from a Relational database system (RDBMS) to a Hadoop file system (HDFS).
  ☆15Updated 3 years ago
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆151Updated last year
• feluelle / finance-data-builder
  Finance 🏦 Data Builder 🛠️ @ postgres 🐘
  ☆18Updated 3 years ago
• VinayChaudhari1996 / pyspark-dataframe-made-easy
  pyspark dataframe made easy
  ☆15Updated 2 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆54Updated last month
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆21Updated 3 months ago
• uplimit / course-dbt
  Analytics engineering with dbt - projects and developer environment
  ☆16Updated 3 months ago
• datastacktv / apache-beam-batch-processing
  Public source code for the Batch Processing with Apache Beam (Python) online course
  ☆17Updated 3 years ago
• josephmachado / change_data_capture
  Repo for CDC with debezium blog post
  ☆25Updated this week
• itversity / data-engineering-spark
  ☆84Updated 2 years ago