Alternatives and similar repositories for bigdata-ETL-pipeline

Users that are interested in bigdata-ETL-pipeline are comparing it to the libraries listed below

• sdw-online / postgres-dwh
  A Postgres data warehouse for processing synthetic data using IAC principles
  ☆19Updated 2 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆44Updated last year
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆48Updated 3 years ago
• cnstlungu / portable-data-stack-airflow
  A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset
  ☆45Updated 11 months ago
• datakickstart / databricks-notebooks
  ☆10Updated 3 years ago
• noahgift / data-engineering-and-dataops
  Duke MIDS: Data Engineering and DataOps Course
  ☆67Updated 9 months ago
• anilkulkarni87 / airflow-docker
  This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …
  ☆34Updated last year
• harrydevforlife / building-lakehouse
  Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…
  ☆32Updated last year
• mikeroyal / Apache-Spark-Guide
  Apache Spark Guide
  ☆34Updated 3 years ago
• jaumpedro214 / ml-streming-kafka-cdc
  Deploying a Machine Learning model streaming application with Apache Kafka
  ☆10Updated 3 years ago
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆42Updated 2 years ago
• KentHsu / Udacity-Data-Streaming-Nanodegree
  Udacity Data Streaming Nanodegree Program
  ☆23Updated 4 years ago
• josephmachado / cost_effective_data_pipelines
  Cost Efficient Data Pipelines with DuckDB
  ☆57Updated 5 months ago
• airscholar / FlinkCommerce
  This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessar…
  ☆45Updated last year
• 1997mahadi / dbt-dlt-ingestion-pipeline
  ☆20Updated last year
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆78Updated 2 years ago
• Stefen-Taime / modern-data-pipeline
  reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.
  ☆14Updated 2 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆56Updated 4 years ago
• khuyentran1401 / prefect-docker
  Demo on how to use Prefect with Docker
  ☆27Updated 3 years ago
• karenbajador / pyspark_greatexpectations
  ☆12Updated 3 years ago
• soft-nougat / dqw-ivves
  DQW is an EDA tool for training data.
  ☆31Updated 3 years ago
• Kavit900 / data-streaming-kafka-flink-postgres
  ☆33Updated last year
• Avaiga / demo-sales-insights
  A repository to create a quick sales application
  ☆15Updated 4 months ago
• khuyentran1401 / detect-data-drift-pipeline
  A pipeline to detect data drift and retrain the model when there is drift
  ☆24Updated 2 years ago
• RyanEricLamb / data-engineering-bus-tracker
  Data engineering project using UK Bus Open Data Service (BODS) to calculate late buses in real-time for any selected region in England. P…
  ☆30Updated 2 years ago
• zsvoboda / ngods
  New generation opensource data stack
  ☆73Updated 3 years ago
• josephmachado / python_essentials_for_data_engineers
  Code for blog at https://www.startdataengineering.com/post/python-for-de/
  ☆87Updated last year
• itversity / mastering-postgresql
  Content related to Mastering Postgresql along with videos.
  ☆18Updated 4 years ago
• rodrigo-arenas / kafkaml-anomaly-detection
  Project for real-time anomaly detection using Kafka and python
  ☆58Updated 2 years ago
• angang-li / data_science_notes
  Keep learning something new
  ☆22Updated 3 years ago