Alternatives and similar repositories for reference_etl:

Users that are interested in reference_etl are comparing it to the libraries listed below

• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆23Updated 10 months ago
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆45Updated 8 months ago
• jackgisby / tfl-bikes-data-pipeline
  Processing TfL data for bike usage with Google Cloud Platform.
  ☆45Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 5 years ago
• team-data-science / learning-apache-spark
  Repository for Apache Spark course at Team Data Science
  ☆16Updated 4 years ago
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 9 months ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆26Updated last year
• guidok91 / spark-movies-etl
  Spark data pipeline that processes movie ratings data.
  ☆28Updated 3 weeks ago
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆41Updated last year
• patelatharva / Data_Pipelines_with_Apache_Airflow
  Creating Data Pipelines with Apache Airflow to manage ETL from Amazon S3 into Amazon Redshift
  ☆14Updated 5 years ago
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆84Updated 5 years ago
• datakickstart / databricks-notebooks
  ☆10Updated 2 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆51Updated 4 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆76Updated 2 years ago
• jacob1421 / RustCheatersDataPipeline
  Data pipeline that scrapes Rust cheater Steam profiles
  ☆52Updated 3 years ago
• subhamkharwal / ease-with-apache-spark
  Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand
  ☆49Updated last year
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated last year
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆47Updated 2 years ago
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆67Updated last year
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆98Updated 8 months ago
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆44Updated 6 months ago
• josephmachado / online_store
  End to end data engineering project
  ☆54Updated 2 years ago
• data-engineers-id / dateng-nongki
  ☆13Updated last year
• itversity / databricks-certification-spark
  Databricks Certified Associate Spark Developer preparation toolkit to setup single node Standalone Spark Cluster along with material in t…
  ☆30Updated last year
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆156Updated 10 months ago
• sarthak-sarbahi / data-analytics-minio-spark
  ☆12Updated last year
• SebasMBK / SunglassesHubETL
  This project is for demonstrating knowledge of Data Engineering tools and concepts and also learning in the process
  ☆46Updated 2 years ago
• PacktPublishing / Snowflake-Cookbook
  Snowflake Cookbook, published by Packt
  ☆79Updated 2 years ago
• maxcotec / Apache-Airflow
  Code base for airflow training series Getting easy with Apache Airflow
  ☆39Updated last year