Alternatives and similar repositories for reference_etl

Users that are interested in reference_etl are comparing it to the libraries listed below

• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆25Updated last year
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆161Updated 2 months ago
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆152Updated 8 months ago
• shravan-kuchkula / udacity-data-eng-proj3
  Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.
  ☆29Updated 2 years ago
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆93Updated 6 years ago
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆64Updated 2 years ago
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆46Updated last year
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆78Updated 2 years ago
• yTek01 / docker-spark-airflow
  ☆40Updated 2 years ago
• data-engineers-id / dateng-nongki
  ☆13Updated 4 months ago
• PacktPublishing / Snowflake-Cookbook
  Snowflake Cookbook, published by Packt
  ☆81Updated 2 years ago
• itversity / data-engineering-spark
  ☆88Updated 3 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆48Updated 3 years ago
• danclark5 / pytesting_db
  Sample pytest tests for testing SQL Server assests.
  ☆46Updated 7 years ago
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆56Updated 3 years ago
• jplane / pyspark-devcontainer
  A simple VS Code devcontainer setup for local PySpark development
  ☆55Updated 2 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆110Updated last year
• AliaHa3 / data-engineering-zoomcamp-project
  Earthquakes API Live Data Project - Data Engineering Zoomcamp Project
  ☆15Updated 2 years ago
• jackgisby / tfl-bikes-data-pipeline
  Processing TfL data for bike usage with Google Cloud Platform.
  ☆46Updated 3 years ago
• marclamberti / webinar-airflow-chart
  Materials of the Official Helm Chart Webinar
  ☆27Updated 4 years ago
• jacob1421 / RustCheatersDataPipeline
  Data pipeline that scrapes Rust cheater Steam profiles
  ☆54Updated 3 years ago
• sizrailev / life-around-data-code
  Code snippets and tools published on the blog at lifearounddata.com
  ☆12Updated 5 years ago
• marclamberti / docker-airflow
  Docker Airflow - Contains a docker compose file for Airflow 2.0
  ☆69Updated 3 years ago
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆114Updated 2 years ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆198Updated last year
• astronomer / airflow-dbt-elt
  This repo contains DAGs demonstrating a variety of ELT patterns using Airflow along with dbt.
  ☆11Updated 2 years ago
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆29Updated 4 years ago
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆89Updated 4 years ago
• moritzkoerber / covid-19-data-engineering-pipeline
  A Covid-19 data pipeline on AWS featuring PySpark/Glue, Docker, Great Expectations, Airflow, and Redshift, templated in CloudFormation an…
  ☆23Updated last year
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆181Updated 3 years ago