Alternatives and similar repositories for bigdata-ETL-pipeline

Users that are interested in bigdata-ETL-pipeline are comparing it to the libraries listed below

• sdw-online / postgres-dwh
  A Postgres data warehouse for processing synthetic data using IAC principles
  ☆18Updated 2 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆56Updated 4 years ago
• itversity / mastering-postgresql
  Content related to Mastering Postgresql along with videos.
  ☆19Updated 4 years ago
• josephmachado / cost_effective_data_pipelines
  Cost Efficient Data Pipelines with DuckDB
  ☆57Updated 3 months ago
• airscholar / RealtimeStreamingEngineering
  This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…
  ☆39Updated last year
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆48Updated 2 years ago
• harrydevforlife / building-lakehouse
  Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…
  ☆32Updated last year
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆44Updated last year
• datakickstart / databricks-notebooks
  ☆10Updated 3 years ago
• cnstlungu / portable-data-stack-airflow
  A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset
  ☆45Updated 9 months ago
• mito-ds / snowflake-streamlit-bank-performance-demo
  A demo of the Mito Streamlit Spreadsheet
  ☆18Updated 2 years ago
• jaumpedro214 / ml-streming-kafka-cdc
  Deploying a Machine Learning model streaming application with Apache Kafka
  ☆10Updated 3 years ago
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆42Updated last year
• noahgift / data-engineering-and-dataops
  Duke MIDS: Data Engineering and DataOps Course
  ☆67Updated 7 months ago
• Kavit900 / data-streaming-kafka-flink-postgres
  ☆33Updated last year
• KentHsu / Udacity-Data-Streaming-Nanodegree
  Udacity Data Streaming Nanodegree Program
  ☆22Updated 4 years ago
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆47Updated 10 months ago
• khuyentran1401 / detect-data-drift-pipeline
  A pipeline to detect data drift and retrain the model when there is drift
  ☆24Updated 2 years ago
• benitomartin / mlops-databricks-credit-default
  Financial Risk Assessment System
  ☆23Updated 9 months ago
• anilkulkarni87 / airflow-docker
  This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …
  ☆33Updated last year
• ankurchavda / data-engineering-zoomcamp
  A course by DataTalks Club that covers Spark, Kafka, Docker, Airflow, Terraform, DBT, Big Query etc
  ☆14Updated 3 years ago
• alod83 / Data-Storytelling-with-Altair-and-AI
  The official repository of the book Data Storytelling with Python Altair and Generative AI
  ☆24Updated 10 months ago
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆102Updated last year
• josephmachado / change_data_capture
  Repo for CDC with debezium blog post
  ☆29Updated 11 months ago
• Avaiga / demo-sales-insights
  A repository to create a quick sales application
  ☆15Updated 3 months ago
• zsvoboda / ngods
  New generation opensource data stack
  ☆72Updated 3 years ago
• hnawaz007 / datalake
  open source data lake
  ☆23Updated 7 months ago
• airscholar / modern-data-eng-dbt-databricks-azure
  In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …
  ☆34Updated last year
• kennethleungty / End-to-End-AutoML-Insurance
  An End-to-End Implementation of AutoML with H2O, MLflow, FastAPI, and Streamlit for Insurance Cross-Sell
  ☆78Updated 3 years ago
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆102Updated 5 months ago