Alternatives and similar repositories for reference_etl

Users that are interested in reference_etl are comparing it to the libraries listed below

• yTek01 / docker-spark-airflow
  ☆39Updated 2 years ago
• rafik-rahoui / End-to-end-data-enginnerring-project
  End-to-end ELT data engineering project
  ☆22Updated 2 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆47Updated 2 years ago
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆91Updated 5 years ago
• data-engineers-id / dateng-nongki
  ☆13Updated last year
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆77Updated 2 years ago
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆156Updated 3 weeks ago
• RWaltersMA / mongo-spark-jupyter
  Docker environment that spins up MongoDB replica set, Spark, and Jupyter Lab. Example code uses PySpark and the MongoDB Spark Connector.
  ☆40Updated 2 years ago
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆154Updated 4 months ago
• josephmachado / online_store
  End to end data engineering project
  ☆56Updated 2 years ago
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆45Updated 10 months ago
• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 5 years ago
• tylerwmarrs / data-engineering-project-doc-templates
  This is project documentation templates derived from CRISP-DM to be used for Data Engineering projects.
  ☆53Updated 3 years ago
• patelatharva / Data_Pipelines_with_Apache_Airflow
  Creating Data Pipelines with Apache Airflow to manage ETL from Amazon S3 into Amazon Redshift
  ☆14Updated 6 years ago
• danielbeach / tinytimmy
  A simple and easy to use Data Quality (DQ) tool built with Python.
  ☆50Updated last year
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆25Updated last year
• zhujun98 / data-engineering
  Spark, Airflow, Kafka
  ☆26Updated 2 years ago
• jackgisby / tfl-bikes-data-pipeline
  Processing TfL data for bike usage with Google Cloud Platform.
  ☆45Updated 2 years ago
• Datavault-UK / automate-dv-demo
  An example dbt project using AutomateDV to create a Data Vault 2.0 Data Warehouse based on the Snowflake TPC-H dataset.
  ☆50Updated last year
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆29Updated 4 years ago
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆178Updated 3 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆53Updated 4 years ago
• marclamberti / docker-airflow
  Docker Airflow - Contains a docker compose file for Airflow 2.0
  ☆68Updated 2 years ago
• IremErturk / dtc-de-capstone-project
  ☆11Updated 3 years ago
• dsartori / ETLDemo
  Python ETL demo for Hackforge
  ☆31Updated last year
• damklis / etljob
  Simple ETL pipeline using Python
  ☆26Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj3
  Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.
  ☆29Updated last year
• mharty3 / energy_data_capstone
  ☆35Updated 2 years ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆169Updated last year
• mehd-io / pyspark-boilerplate-mehdio
  Pyspark boilerplate for running prod ready data pipeline
  ☆28Updated 4 years ago