Alternatives and similar repositories for reference_etl

Users that are interested in reference_etl are comparing it to the libraries listed below

• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆95Updated 6 years ago
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆165Updated 3 months ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆204Updated last year
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 6 years ago
• itversity / data-engineering-spark
  ☆88Updated 3 years ago
• datarootsio / tutorial-great-expectations
  A tutorial for the Great Expectations library.
  ☆73Updated 4 years ago
• gabriel-garciae / one_billion_row_challenge_python
  ☆17Updated last year
• data-engineers-id / dateng-nongki
  ☆13Updated 5 months ago
• jacob1421 / RustCheatersDataPipeline
  Data pipeline that scrapes Rust cheater Steam profiles
  ☆54Updated 3 years ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆25Updated last year
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆78Updated 2 years ago
• ysfesr / Building-Data-LakeHouse
  Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
  ☆49Updated 2 years ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆168Updated 2 years ago
• KentHsu / Udacity-Data-Streaming-Nanodegree
  Udacity Data Streaming Nanodegree Program
  ☆23Updated 4 years ago
• iam-mhaseeb / Skytrax-Data-Warehouse
  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …
  ☆140Updated 5 years ago
• josephwibowo / MeetBaeArea
  Airflow ETL for Meetup API
  ☆45Updated 6 years ago
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆47Updated last year
• shravan-kuchkula / dataEngineering
  A repo to track data engineering projects
  ☆13Updated 3 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆158Updated 5 years ago
• konosp / dbt-airflow-docker-compose
  Execution of DBT models using Apache Airflow through Docker Compose
  ☆126Updated 2 years ago
• uhussain / WebCrawlerForInflation
  Price Crawler - Tracking Price Inflation
  ☆187Updated 5 years ago
• patelatharva / Data_Pipelines_with_Apache_Airflow
  Creating Data Pipelines with Apache Airflow to manage ETL from Amazon S3 into Amazon Redshift
  ☆14Updated 6 years ago
• PacktPublishing / Snowflake-Cookbook
  Snowflake Cookbook, published by Packt
  ☆82Updated 2 years ago
• josephmachado / online_store
  End to end data engineering project
  ☆57Updated 3 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• damavis / advanced-airflow
  Apache Airflow advanced functionalities examples
  ☆21Updated last year
• cnstlungu / portable-data-stack-airflow
  A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset
  ☆46Updated last week
• magogate / DataWarehouse_And_Reporting
  ☆46Updated 4 years ago
• jackgisby / tfl-bikes-data-pipeline
  Processing TfL data for bike usage with Google Cloud Platform.
  ☆46Updated 3 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆110Updated last year