Alternatives and similar repositories for airflow_kafka_cassandra_mongodb

Users that are interested in airflow_kafka_cassandra_mongodb are comparing it to the libraries listed below

• darshilparmar / twitter-airflow-data-engineering-project
  YouTube tutorial project
  ☆105Updated 2 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆44Updated last year
• sidharth1805 / Spotify_etl
  ☆142Updated 2 years ago
• dogukannulu / csv_extract_airflow_docker
  Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.
  ☆37Updated 2 years ago
• dogukannulu / kafka_spark_structured_streaming
  Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra
  ☆143Updated 2 years ago
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆102Updated 7 months ago
• itversity / data-engineering-spark
  ☆88Updated 3 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆28Updated 2 years ago
• coder2j / airflow-docker
  Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (https://www.youtube.com/c/coder2j)
  ☆323Updated last year
• airscholar / RedditDataEngineering
  This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…
  ☆159Updated 2 years ago
• afaqueahmad7117 / spark-experiments
  Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews
  ☆170Updated last month
• coder2j / pyspark-tutorial
  PySpark Tutorial for Beginners - Practical Examples in Jupyter Notebook with Spark version 3.4.1. The tutorial covers various topics like…
  ☆135Updated 2 years ago
• airscholar / e2e-data-engineering
  An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Ka…
  ☆282Updated 8 months ago
• JesusAcuna / data-engineering-project
  ☆29Updated last year
• airscholar / realtime-voting-data-engineering
  This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…
  ☆42Updated last year
• josephmachado / online_store
  End to end data engineering project
  ☆57Updated 3 years ago
• darshilparmar / stock-market-kafka-data-engineering-project
  ☆205Updated 2 years ago
• itversity / data-engineering-on-gcp
  Data Engineering on GCP
  ☆39Updated 3 years ago
• josephmachado / python_essentials_for_data_engineers
  Code for blog at https://www.startdataengineering.com/post/python-for-de/
  ☆87Updated last year
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆84Updated 5 months ago
• SatadruMukherjee / Data-Preprocessing-Models
  ☆70Updated this week
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆110Updated last year
• Wittline / uber-expenses-tracking
  The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such …
  ☆121Updated 3 years ago
• jackgisby / tfl-bikes-data-pipeline
  Processing TfL data for bike usage with Google Cloud Platform.
  ☆45Updated 3 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆157Updated 5 years ago
• PacktPublishing / Building-ETL-Pipelines-with-Python
  Building ETL Pipelines with Python
  ☆163Updated last year
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆93Updated 6 years ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆104Updated 4 years ago
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆78Updated 2 years ago
• PacktPublishing / Mastering-Big-Data-Analytics-with-PySpark
  Mastering Big Data Analytics with PySpark, Published by Packt
  ☆161Updated last year