☆45Jul 6, 2024Updated 2 years ago
Alternatives and similar repositories for Data-Engineering-Streaming-Project
Users that are interested in Data-Engineering-Streaming-Project are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆10May 5, 2022Updated 4 years ago
- Courses and projects on Data Camp☆11Jun 28, 2020Updated 6 years ago
- ☆30Nov 16, 2023Updated 2 years ago
- ☆13May 11, 2025Updated last year
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆43Sep 26, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Your personal legal assistant☆12Apr 2, 2023Updated 3 years ago
- Code for the Data Engineering Zoomcamp☆20Dec 12, 2022Updated 3 years ago
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆44Dec 28, 2022Updated 3 years ago
- used Airflow, Postgres, Kafka, Spark, and Cassandra, and GitHub Actions to establish an end-to-end data pipeline☆33Oct 25, 2023Updated 3 years ago
- Documenting the data cleaning process on a bank statement dataset using the python libraries, NumPy and Pandas.☆10Apr 19, 2023Updated 3 years ago
- This project leverages GCS, Composer, Dataflow, BigQuery, and Looker on Google Cloud Platform (GCP) to build a robust data engineering so…☆44Dec 12, 2023Updated 2 years ago
- Modeling customer churn with Spark☆12Jan 24, 2019Updated 7 years ago
- Skunks Skool Tutorials☆17Dec 19, 2022Updated 3 years ago
- Content for a talk on "The wonderful world of data quality tools in Python"☆18May 5, 2021Updated 5 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆13Oct 28, 2025Updated last year
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆122Jan 8, 2026Updated 9 months ago
- A fully integrated platform for aggregating, visualising and analysing alternative data☆14Mar 15, 2024Updated 2 years ago
- This repository about how to deploy machine learning model end serving with FastAPI and using MLFlow-MINIO☆19Jun 11, 2023Updated 3 years ago
- Example Flink and Kafka integration project☆15Nov 28, 2015Updated 10 years ago
- This is a guide or so called cheatsheet for anyone that is interested in AWS Tech U position.☆17Aug 15, 2023Updated 3 years ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆66Jul 21, 2023Updated 3 years ago
- commit-linter helps you lint your commit messages according to commit conventions☆10Aug 17, 2023Updated 3 years ago
- Docker with Airflow and Spark standalone cluster☆264Aug 5, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Fine tuned LLM examples running on Kubernetes☆10Oct 1, 2023Updated 3 years ago
- ☆11Oct 8, 2021Updated 5 years ago
- Optimal binning algorithm and function to apply on a pandas DataFrame☆11Mar 7, 2023Updated 3 years ago
- Implement different variants of gradient descent in python using numpy☆11Apr 23, 2019Updated 7 years ago
- ☆10Jan 7, 2022Updated 4 years ago
- The goal of this project is to analyse the impact of Covid-19 on the Aviation industry through data engineering processes using technolog…☆13Jun 26, 2022Updated 4 years ago
- A containerized approach using Apache Kafka, Spark, Cassandra, Hive, Jupyter, and Docker-compose.☆14Apr 14, 2021Updated 5 years ago
- ☆12Mar 6, 2021Updated 5 years ago
- Collection Of All Python Notebooks Shared On Twitter☆11Apr 10, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Dockerfile for OpenLogReplicator☆21Mar 3, 2026Updated 7 months ago
- XIRR (using Python) to calculate return on investments done at different time periods which need not be periodic.☆15Oct 3, 2020Updated 6 years ago
- ☆18Nov 27, 2020Updated 5 years ago
- Lambda data architecture reference project — dbt medallion models, Airflow DAGs, Superset dashboards, and Marquez lineage for Iowa retail…☆14Jul 12, 2026Updated 3 months ago
- ☆13Dec 5, 2025Updated 10 months ago
- GitHub Action That Submits Argo Workflows For Execution on Your GKE Cluster☆16Jan 25, 2021Updated 5 years ago
- (Python, PySpark)☆10Nov 15, 2020Updated 5 years ago