This project introduces PySpark, a powerful open-source framework for distributed data processing. We explore its architecture, components, and applications for real-time data analysis.
☆47Sep 26, 2024Updated last year
Alternatives and similar repositories for Real-Time-PySpark
Users that are interested in Real-Time-PySpark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repo consists of all important concepts for data engineers.☆11Jun 2, 2026Updated 2 months ago
- ☆17Jul 26, 2025Updated last year
- Apache Airflow advanced functionalities examples☆21Mar 22, 2024Updated 2 years ago
- An Airflow plugin, providing an admin UI to conveniently start backfills. Usable with Airflow 1, 2 and Cloud Composer☆14Aug 16, 2022Updated 3 years ago
- ☆39Oct 27, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- pyspark dataframe made easy☆16Dec 15, 2021Updated 4 years ago
- Build and run Spark Structured Streaming pipelines in Hadoop - project using PySpark.☆13Jun 6, 2019Updated 7 years ago
- ☆16Nov 22, 2025Updated 8 months ago
- ☆13Nov 4, 2020Updated 5 years ago
- a high-performance, lightweight and human friendly serving engine for scrapy☆29Mar 17, 2025Updated last year
- capstone project for Dataengineer.io bootcamp Public Repo☆12Feb 20, 2024Updated 2 years ago
- Leverage the Databricks Solution Accelerator for DNS analytics to accelerate time to detection and response across petabytes of data. Tap…☆14Jun 16, 2023Updated 3 years ago
- ☆15May 23, 2022Updated 4 years ago
- The Ultimate Guide to Snowpark, published by Packt☆16Jun 8, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Building an PD, LGD and EAD Model for Financial Modeling.☆15Dec 19, 2023Updated 2 years ago
- Heart disease prediction with logistic regression using SAS Studio. The dataset is taken from UCI Machine Learning about heart disease.☆13Apr 20, 2023Updated 3 years ago
- Web Applicaiton Firewall Implementation using Deep Learning☆16Feb 3, 2023Updated 3 years ago
- My solutions for the Udacity Data Engineering Nanodegree☆34Oct 14, 2019Updated 6 years ago
- Exploring internet domain names with deep learning using vector embeddings☆19Dec 14, 2018Updated 7 years ago
- ☆22Oct 21, 2024Updated last year
- Implementing best practices for PySpark ETL jobs and applications.☆2,120Jan 1, 2023Updated 3 years ago
- ☆19Dec 1, 2024Updated last year
- This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessar…☆51Dec 4, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Codes related to data wrangling☆14Apr 12, 2020Updated 6 years ago
- This is the first project where we worked on apache spark, In this project what we have done is that we downloaded the datasets from KAGG…☆23Oct 14, 2021Updated 4 years ago
- TTS utility☆12Aug 2, 2020Updated 6 years ago
- Complete Automation framework for API using python + pytest +requests +github actions☆21Oct 26, 2023Updated 2 years ago
- ☆69Jun 21, 2026Updated last month
- ☆147Jan 31, 2023Updated 3 years ago
- ☆17Aug 30, 2021Updated 4 years ago
- A platform that helps developers to better understand CSS through declaration interpretation and may even improve them through suggestion…☆14Jul 3, 2021Updated 5 years ago
- ☆21Aug 17, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆12Apr 28, 2020Updated 6 years ago
- Generate OpenAPI 3.x.x using Pydantic☆11Feb 9, 2023Updated 3 years ago
- ☆19May 12, 2021Updated 5 years ago
- Examples of Using DBTunnel☆11Apr 24, 2024Updated 2 years ago
- (Python, PySpark)☆10Nov 15, 2020Updated 5 years ago
- Unsupervised concept extraction from clinical text☆14Jun 17, 2024Updated 2 years ago
- Docker Images with Databricks Connect Ready to go☆24Dec 26, 2023Updated 2 years ago