Alternatives and similar repositories for reference_etl

Users that are interested in reference_etl are comparing it to the libraries listed below

• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆25Updated last year
• patelatharva / Data_Pipelines_with_Apache_Airflow
  Creating Data Pipelines with Apache Airflow to manage ETL from Amazon S3 into Amazon Redshift
  ☆14Updated 6 years ago
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆152Updated 9 months ago
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆96Updated 6 years ago
• uhussain / WebCrawlerForInflation
  Price Crawler - Tracking Price Inflation
  ☆187Updated 5 years ago
• yTek01 / docker-spark-airflow
  ☆40Updated 2 years ago
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆165Updated 2 months ago
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆29Updated 4 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆78Updated 2 years ago
• KentHsu / Udacity-Data-Streaming-Nanodegree
  Udacity Data Streaming Nanodegree Program
  ☆23Updated 4 years ago
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆47Updated last year
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆110Updated last year
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆114Updated 2 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆158Updated 5 years ago
• itversity / data-engineering-spark
  ☆88Updated 3 years ago
• zhujun98 / data-engineering
  Spark, Airflow, Kafka
  ☆25Updated 2 years ago
• josephmachado / online_store
  End to end data engineering project
  ☆57Updated 3 years ago
• dsartori / ETLDemo
  Python ETL demo for Hackforge
  ☆32Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 6 years ago
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆73Updated 2 months ago
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆106Updated 8 months ago
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated last year
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆42Updated 2 years ago
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆182Updated 3 years ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆200Updated last year
• jackgisby / tfl-bikes-data-pipeline
  Processing TfL data for bike usage with Google Cloud Platform.
  ☆46Updated 3 years ago
• marclamberti / docker-airflow
  Docker Airflow - Contains a docker compose file for Airflow 2.0
  ☆69Updated 3 years ago
• danclark5 / pytesting_db
  Sample pytest tests for testing SQL Server assests.
  ☆46Updated 7 years ago
• itversity / mastering-postgresql
  Content related to Mastering Postgresql along with videos.
  ☆18Updated 4 years ago
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆60Updated last year