Alternatives and similar repositories for reference_etl:

Users that are interested in reference_etl are comparing it to the libraries listed below

• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆22Updated 9 months ago
• patelatharva / Data_Pipelines_with_Apache_Airflow
  Creating Data Pipelines with Apache Airflow to manage ETL from Amazon S3 into Amazon Redshift
  ☆14Updated 5 years ago
• gabriel-garciae / one_billion_row_challenge_python
  ☆17Updated 9 months ago
• mdh266 / AirflowDataPipeline
  Example of an ETL Pipeline using Airflow
  ☆34Updated 7 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆50Updated 4 years ago
• subhamkharwal / ease-with-apache-spark
  Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand
  ☆47Updated last year
• yTek01 / docker-spark-airflow
  ☆36Updated 2 years ago
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆154Updated last month
• dsartori / ETLDemo
  Python ETL demo for Hackforge
  ☆31Updated last year
• spbail / data-quality-tools
  Content for a talk on "The wonderful world of data quality tools in Python"
  ☆19Updated 3 years ago
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆45Updated 7 months ago
• 1997mahadi / dbt-dlt-ingestion-pipeline
  ☆17Updated 7 months ago
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆56Updated 3 years ago
• shravan-kuchkula / udacity-data-eng-proj3
  Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.
  ☆29Updated last year
• Apress / building-a-data-warehouse
  Source code for 'Building a Data Warehouse' by Vincent Rainardi
  ☆30Updated 7 years ago
• alexandraabbas / apache-airflow-course
  Public source code for the Udemy online course Apache Airflow: Complete Hands-On Beginner to Advanced Class.
  ☆63Updated 4 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 8 months ago
• guidok91 / spark-movies-etl
  Spark data pipeline that processes movie ratings data.
  ☆28Updated this week
• itversity / mastering-postgresql
  Content related to Mastering Postgresql along with videos.
  ☆15Updated 3 years ago
• shravan-kuchkula / dataEngineering
  A repo to track data engineering projects
  ☆13Updated 2 years ago
• ismaildawoodjee / GreatEx
  A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …
  ☆21Updated 2 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆46Updated 2 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆25Updated last year
• rafik-rahoui / End-to-end-data-enginnerring-project
  End-to-end ELT data engineering project
  ☆20Updated 2 years ago
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆43Updated 5 months ago
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆82Updated 5 years ago
• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 5 years ago
• josephmachado / cost_effective_data_pipelines
  Cost Efficient Data Pipelines with DuckDB
  ☆51Updated 7 months ago
• josephmachado / data_engineering_best_practices_log
  Code to demonstrate data engineering metadata & logging best practices
  ☆16Updated last year
• JoseRFJuniorLLMs / PySpark-ETL
  PySpark-ETL
  ☆23Updated 5 years ago