Alternatives and similar repositories for Modern_E2E_ServerlessDataPipeline_NextGenDataLake

Users that are interested in Modern_E2E_ServerlessDataPipeline_NextGenDataLake are comparing it to the libraries listed below

• ayyoubmaul / hadoop-docker
  ☆21Updated 11 months ago
• spark-examples / pyspark-examples
  Pyspark RDD, DataFrame and Dataset Examples in Python language
  ☆1,342Updated 2 months ago
• areibman / pyspark_exercises
  Practice your Pyspark skills!
  ☆100Updated 4 years ago
• AlexIoannides / pyspark-example-project
  Implementing best practices for PySpark ETL jobs and applications.
  ☆2,064Updated 3 years ago
• cartershanklin / pyspark-cheatsheet
  PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster
  ☆488Updated last year
• Marcel-Jan / docker-hadoop-spark
  Multi-container environment with Hadoop, Spark and Hive
  ☆232Updated 9 months ago
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆108Updated last month
• kishlayjeet / Zomato-Twitter-Sentiment-Analysis-Data-Pipeline
  This project provides valuable customer sentiment insights for Zomato by tracking and analyzing tweets related to their brand and service…
  ☆14Updated 2 years ago
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆88Updated 6 years ago
• DeepHiveMind / gateway_to_DeepReinforcementLearning_DeepNN
  Welcome to the wonderland of "AI" = f(DL, RL, DRL, ML, NLP, KG, MLOPS)
  ☆29Updated 3 years ago
• vedanthv / data-engineering-portfolio
  Cool DE Projects
  ☆57Updated last month
• Xadra-T / End2End-Data-Pipeline
  An end-to-end, containerized data pipeline for near-real-time user event analytics using Kafka, ClickHouse, Airflow, and PySpark. Made to…
  ☆56Updated 4 months ago
• tirthajyoti / Spark-with-Python
  Fundamentals of Spark with Python (using PySpark), code examples
  ☆362Updated 3 years ago
• RSKriegs / finnhub-streaming-data-pipeline
  Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more
  ☆373Updated 2 years ago
• davidzajac1 / zillacode
  Open Source LeetCode for PySpark, Spark, Pandas and DBT/Snowflake
  ☆255Updated 7 months ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆34Updated 5 years ago
• dogukannulu / kafka_spark_structured_streaming
  Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra
  ☆144Updated 2 years ago
• OBenner / data-engineering-interview-questions
  More than 2000+ Data engineer interview questions.
  ☆1,506Updated 3 weeks ago
• aminenouira-db / ml-training-20220621
  ☆24Updated 3 years ago
• sonhmai / data-systems-design
  System Design, Solution Architecture, Data Systems Practice
  ☆69Updated 5 months ago
• airscholar / e2e-data-engineering
  An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Ka…
  ☆312Updated 11 months ago
• derar-alhussein / Databricks-Certified-Data-Engineer-Associate
  The resources of the preparation course for Databricks Data Engineer Associate certification exam
  ☆585Updated last month
• developer-advocacy-dremio / iceberg-intro-lessons
  Repo for Introduction to Iceberg Video
  ☆21Updated last year
• kevinschaich / pyspark-cheatsheet
  🐍 Quick reference guide to common patterns & functions in PySpark.
  ☆652Updated 2 years ago
• abulbasar / pyspark-examples
  Code examples on Apache Spark using python
  ☆108Updated 3 years ago
• andkret / weather-app
  This is the repo of the Weather app from my YouTube video
  ☆20Updated 2 years ago
• ketgo / marshmallow-pyspark
  Marshmallow serializer integration with pyspark
  ☆12Updated 2 years ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆104Updated 5 years ago
• shafiab / HashtagCashtag
  My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on ​lambda architecture​, that aggrega…
  ☆509Updated 3 years ago
• subhamkharwal / ease-with-apache-spark
  Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand
  ☆56Updated 2 years ago