Implementation of an ETL process for real-time sentiment analysis of tweets with Docker, Apache Kafka, Spark Streaming, MongoDB and Delta Lake
☆19May 6, 2023Updated 3 years ago
Alternatives and similar repositories for pyspark-etl-twitter
Users that are interested in pyspark-etl-twitter are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Oct 19, 2023Updated 2 years ago
- streamlit dashboard to analyse data☆13May 6, 2023Updated 3 years ago
- Scan and monitor your network effortlessly! Nmap Prometheus Exporter provides insights into network health and security with Prometheus-c…☆15Oct 2, 2023Updated 2 years ago
- The project aims to automate the extraction of data from a YouTube channel, transform the data into a suitable format, and make it availa…☆12Sep 24, 2023Updated 2 years ago
- A data pipeline for processing football data using Python and SQL☆13Sep 12, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- trading by Deep Q-Network☆15Oct 20, 2016Updated 9 years ago
- ETL (Extract, Transform and Load) with the Spark Python API (PySpark) and Hadoop Distributed File System (HDFS)☆17Dec 18, 2018Updated 7 years ago
- Project to experiment with a microservices architecture based on Apache Kafka☆23Jul 8, 2023Updated 3 years ago
- An End-to-End ETL data pipeline that leverages pyspark parallel processing to process about 25 million rows of data coming from a SaaS ap…☆27Dec 7, 2022Updated 3 years ago
- A guide to writing an amazing readme for your data science project.☆21Feb 22, 2023Updated 3 years ago
- A sample of some of data science projects I have worked on☆18Oct 19, 2021Updated 4 years ago
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆25May 14, 2022Updated 4 years ago
- ☆18Feb 9, 2023Updated 3 years ago
- A Jekyll version of the "Massively" theme by HTML5 UP.☆16Dec 24, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Comparative Study and Implementation of Five Factor Model and Myers-Briggs Type Indicator Model☆11Sep 28, 2023Updated 2 years ago
- Handle Big Data for Machine Learning using Python and PySpark, Building ETL Pipelines with PySpark, MongoDB, and Bokeh☆10Nov 12, 2021Updated 4 years ago
- ☆24Dec 4, 2023Updated 2 years ago
- A user-friendly Command & Control (C&C) web platform for remote monitoring, management, and task automation across multiple devices.☆14Sep 4, 2026Updated 2 weeks ago
- MlOps End 2 End☆13Jul 6, 2023Updated 3 years ago
- 📕Ansible playbooks for Raspberry Pi, Linux and Mac☆14Dec 22, 2024Updated last year
- ☆14Feb 17, 2025Updated last year
- Scientific Visualization application for tailored post-processing relying on a ParaViewWeb backend.☆22May 11, 2021Updated 5 years ago
- Trading App☆11Jan 8, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Prometheus exporter for Amazon Smart Air Quality Monitor☆12Jan 21, 2022Updated 4 years ago
- Inventory is an application that tracks deployed services/containers. It was built with a homelab in mind.☆16Jun 9, 2025Updated last year
- Python Pydantic model of the Prometheus Alertmanager alert payload☆10Jul 24, 2023Updated 3 years ago
- Streamlit Dashboard over Superstore Data stored in Postgres Docker container. With SQLAlchemy + Plotly Express☆12Oct 16, 2024Updated last year
- Examples and code for the Practical Machine Learning workshop series☆24Mar 29, 2021Updated 5 years ago
- This repo contains Big Data Project, its about "Real Time Twitter Sentiment Analysis via Kafka, Spark Streaming, MongoDB and Django Dashb…☆49Jul 5, 2026Updated 2 months ago
- ryantoken.com v3 - written in Svelte, Tailwind, and mdsvex. Replaced by ryantoken.com v4☆11Jul 27, 2025Updated last year
- Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks☆24Apr 2, 2022Updated 4 years ago
- ☆34Feb 20, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- django app built on postgres with Djang-Plotly-Dash installed and set up, ready to start adding templates.☆10Dec 16, 2020Updated 5 years ago
- Telegram bot that manages creation of queues / attendance lists for periodic events.☆15Dec 23, 2024Updated last year
- this is a simple sso for devops api☆12May 31, 2014Updated 12 years ago
- CLI to start Flask projects☆12Aug 24, 2024Updated 2 years ago
- A template for Python projects that need to use a relational database, including tooling for managing schema migrations and testing again…☆13Dec 13, 2024Updated last year
- A common standard for sharing data in the grant ecosystem.☆27Updated this week
- Sample trading strategies using price data and conventional indicators☆17Jan 18, 2017Updated 9 years ago