Alternatives and similar repositories for pyspark-etl-twitter

Users that are interested in pyspark-etl-twitter are comparing it to the libraries listed below

• dogukannulu / crypto_api_kafka_airflow_streaming
  Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase
  ☆16Updated last year
• ABZ-Aaron / coincap-api-pipeline
  A simple pipeline utilising cron, Postgres, AWS EC2, and Metabase
  ☆12Updated last year
• im-nsk / Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse
  This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…
  ☆22Updated 2 years ago
• andfanilo / superstore-dashboard-streamlit
  Streamlit Dashboard over Superstore Data stored in Postgres Docker container. With SQLAlchemy + Plotly Express
  ☆13Updated 11 months ago
• andreichiro / data_engineer_end2end
  End-to-end data engineer project
  ☆23Updated 2 years ago
• MartyC-137 / Data-Engineering
  A project portfolio to accompany my resume
  ☆29Updated 2 years ago
• zkan / dtc-data-engineering-zoomcamp-project
  DataTalks.Club's Data Engineering Zoomcamp Project
  ☆23Updated 3 years ago
• moontucer / Data-Streaming-Project
  used Airflow, Postgres, Kafka, Spark, and Cassandra, and GitHub Actions to establish an end-to-end data pipeline
  ☆29Updated last year
• kishlayjeet / Stock-Market-Real-Time-Data-Pipeline-with-Apache-Kafka-and-Cassandra
  A end-to-end real-time stock market data pipeline with Python, AWS EC2, Apache Kafka, and Cassandra Data is processed on AWS EC2 with Apa…
  ☆25Updated 2 years ago
• LinkedInLearning / end-to-end-data-engineering-project-4413618
  This repo is for the Linkedin Learning course: End-to-End Data Engineering Project
  ☆24Updated last year
• ryanbrownnetworking777 / dataengineerio-capstone-ryanbrown
  capstone project for Dataengineer.io bootcamp Public Repo
  ☆12Updated last year
• AuFeld / Data_Engineering_Projects
  A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…
  ☆15Updated 4 years ago
• rafik-rahoui / End-to-end-data-enginnerring-project
  End-to-end ELT data engineering project
  ☆22Updated 2 years ago
• manuel-lang / Data-Engineering-Nanodegree
  Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…
  ☆57Updated 2 years ago
• iobruno / data-engineering-examples
  Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; K…
  ☆68Updated 3 months ago
• harshkavdikar1 / Tweet-Analysis-With-Kafka-and-Spark
  A real time analytics dashboard to analyze the trending hashtags and @ mentions at any location using kafka and spark streaming.
  ☆22Updated 11 months ago
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆42Updated last year
• longNguyen010203 / Youtube-Recommend-Master-ETL-Pipeline
  A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Polars, Doc…
  ☆23Updated 10 months ago
• airscholar / realtime-voting-data-engineering
  This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…
  ☆41Updated last year
• BenSchr / Udacity-Data-Engineering-Projects
  My solutions for the Udacity Data Engineering Nanodegree
  ☆34Updated 5 years ago
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆102Updated 5 months ago
• dogukannulu / csv_extract_airflow_docker
  Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.
  ☆37Updated 2 years ago
• dogukannulu / kafka_spark_structured_streaming
  Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra
  ☆143Updated 2 years ago
• Wittline / uber-expenses-tracking
  The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such …
  ☆121Updated 3 years ago
• Nathnael12 / Datawarehouse
  Fully dockerized Data Warehouse (DWH) using Airflow, dbt, PostgreSQL and dashboard using redash
  ☆24Updated 2 years ago
• josephmachado / python_essentials_for_data_engineers
  Code for blog at https://www.startdataengineering.com/post/python-for-de/
  ☆87Updated last year
• SourabhSinghRana / real-time_crypto_data_pipeline_using_kafka
  I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…
  ☆29Updated 2 years ago
• nama1arpit / reddit-streaming-pipeline
  A real-time reddit data streaming pipeline for sentiment analysis of various subreddits
  ☆132Updated 2 years ago
• ankurchavda / data-engineering-zoomcamp
  A course by DataTalks Club that covers Spark, Kafka, Docker, Airflow, Terraform, DBT, Big Query etc
  ☆14Updated 3 years ago
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆102Updated last year