Wesley-Bos / spark3.0-examples

Related projects: ⓘ

• dsynkov / spark-livy-on-airflow-workspace
  A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.
  ☆39Updated 3 years ago
• indiacloudtv / structuredstreamingkafkapyspark
  Apche Spark Structured Streaming with Kafka using Python(PySpark)
  ☆41Updated 5 years ago
• pran4ajith / spark-twitter-streaming
  A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…
  ☆29Updated 4 years ago
• shawlu95 / Data-Engineering-Toolbox
  Lecture notes, lab notes, and links to helpful resources to pass Google Certification Exam for Professional Data Engineer.
  ☆16Updated 2 years ago
• MBKraus / incremental_training
  Repo that relates to the Medium blog 'Keeping your ML model in shape with Kafka, Airflow' and MLFlow'
  ☆120Updated last year
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆56Updated last year
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆89Updated 2 years ago
• gabfr / data-engineering-nanodegree
  notebooks produced throughout the Udacity's Nanodegree Data Engineering Course
  ☆72Updated 3 years ago
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆120Updated last year
• K-G-PRAJWAL / Big-Data-Engineering
  ☆17Updated last year
• BenSchr / Udacity-Data-Engineering-Projects
  My solutions for the Udacity Data Engineering Nanodegree
  ☆33Updated 4 years ago
• jukkakansanaho / udacity-dend-project-3
  Udacity Data Engineer Nano Degree - Project-3 (Data Warehouse)
  ☆22Updated 5 years ago
• rodrigo-arenas / kafkaml-anomaly-detection
  Project for real-time anomaly detection using Kafka and python
  ☆55Updated last year
• kroudir / Data-Engineer-Nanodegree-Projects-Udacity
  Projects done in the Data Engineer Nanodegree Program by Udacity.com
  ☆83Updated last year
• andfanilo / pyspark-tutorial
  Jupyter notebooks for pyspark tutorials given at University
  ☆102Updated 3 weeks ago
• itversity / data-engineering-spark
  ☆84Updated 2 years ago
• itversity / spark-sql
  Apache Spark using SQL
  ☆14Updated 3 years ago
• soumilshah1995 / Airflow-Tutorials-
  Airflow Tutorials
  ☆24Updated 3 years ago
• SomanathSankaran / spark_medium
  My Git Repo for Csv Data
  ☆19Updated 4 years ago
• kaantas / kafka-twitter-spark-streaming
  Counting Tweets Per User in Real-Time
  ☆41Updated 7 years ago
• klescosia / aws-glue-delta-lake
  This repository is for demonstrating the capability to do SQL-based UPDATES, DELETES, and INSERTS directly in the Data Lake using Amazon …
  ☆16Updated 3 years ago
• mahdyne / pyspark-tut
  ☆22Updated 3 years ago
• JoseRFJuniorLLMs / PySpark-ETL
  PySpark-ETL
  ☆23Updated 4 years ago
• yugokato / Spark-and-Kafka_IoT-Data-Processing-and-Analytics
  Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time
  ☆65Updated 7 years ago
• shravan-kuchkula / udacity-data-eng-proj2
  A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…
  ☆24Updated 2 years ago
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆39Updated 5 years ago
• shabie / streaming_nd
  Data Streaming Nanodegree (from Udacity) exercises, projects and their solutions
  ☆16Updated last year
• abulbasar / pyspark-examples
  Code examples on Apache Spark using python
  ☆101Updated 2 years ago
• jleetutorial / python-spark-streaming
  ☆149Updated 6 years ago
• nareshk1290 / dataquest-DE
  Data Quest - Data Engineer Learning and Projects
  ☆24Updated 5 years ago