A dockerized 5 min. mini-batch data pipeline. Spark Structured Streaming: reading from Kafka to PostgreSQL as a sink DB. Airflow, Kafka, PySpark, PostgreSQL, Streamlit
☆10Jul 17, 2024Updated 2 years ago
Alternatives and similar repositories for data-engineering-zoomcamp-capstone-01
Users that are interested in data-engineering-zoomcamp-capstone-01 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆17Mar 31, 2024Updated 2 years ago
- Compiled TF-Lite for AWS Lambda☆13Nov 23, 2023Updated 2 years ago
- The Modern Data Stack in a (Smaller) Box☆12Jan 28, 2023Updated 3 years ago
- Conversion of audio files to text using whisper from OpenAI with a simple tkinter GUI☆10Apr 13, 2023Updated 3 years ago
- ☆14Sep 14, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Midterms project for #mlzoomcamp 2023 cohort☆10Feb 23, 2024Updated 2 years ago
- Data from the state of data science survey released by Anaconda each year.☆16Aug 15, 2024Updated 2 years ago
- A data pipeline for the ingestion & visualisation of U.S Geological Survey Earthquake data☆14Jun 24, 2024Updated 2 years ago
- CI/CD repository template to automate deployments of your production flows☆15Jul 1, 2024Updated 2 years ago
- Capstone Project for the IBM Data Engineering Professional Certification.☆13Mar 7, 2022Updated 4 years ago
- Lightweight, open source, locally-hosted Modern Data Stack☆19Apr 7, 2025Updated last year
- Autonomous UAV-Based Maritime SAR using onboard YOLOv8/v11 for real-time swimmer detection and precision life buoy deployment. Combines G…☆17Aug 7, 2026Updated 3 months ago
- Modern Data Stack in a box with dbt-duckdb and Apache Superset☆16Updated this week
- Tutorial Source Code for Vue-Cli with Agency-Boostrap-Theme☆11Jan 9, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Practice your pandas skills!☆11Dec 10, 2019Updated 6 years ago
- capstone project for Dataengineer.io bootcamp Public Repo☆12Feb 20, 2024Updated 2 years ago
- Solutions for Data Engineering Zoomcamp, Winter 2022.☆16Apr 22, 2022Updated 4 years ago
- Set up a Cost-Effective Modern Data Stack for a Charity☆20Mar 26, 2025Updated last year
- ☆15May 13, 2024Updated 2 years ago
- In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO,…☆11Jun 27, 2023Updated 3 years ago
- ☆15Apr 17, 2024Updated 2 years ago
- ☆17Mar 4, 2023Updated 3 years ago
- ☆12Mar 30, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Python TensorFlow Lite (tflite) for amazonlinux/aws lambda.☆20Aug 4, 2020Updated 6 years ago
- Learn Apache Airflow with examples☆21Oct 10, 2023Updated 3 years ago
- Building a Comprehensive Repository of Hromada-Level Data in Ukraine to Facilitate Research and Informed Policy Decisions. This repositor…☆17Nov 6, 2026Updated last week
- Template for Retreival-Augmented Generation (RAG) application using Milvus for vector storage, LangGraph for ReAct agentic workflows, and…☆12May 21, 2025Updated last year
- Backup for NYC TLC data for the DE Zoomcamp course☆215Jul 19, 2022Updated 4 years ago
- Android app - Chronic symptom tracking☆18Updated this week
- This is a simple object detection application, which can be used to detect military objects☆15Nov 16, 2020Updated 6 years ago
- A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…☆15Apr 29, 2021Updated 5 years ago
- A sophisticated trading system leveraging local LLM deployment through Ollama, distributed computing with Apache Spark, and vector-based …☆15Feb 3, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Cloud Functions streaming insert to BigQuery (with Cloud Pub/Sub trigger). In this example, the function will make a REST API call to get…☆29Aug 28, 2023Updated 3 years ago
- Ecommerce Realtime Data Pipeline (Data Modeling, Workflow Orchestration, Change Data Capture, Analytical Database and Dashboarding)☆72Mar 9, 2024Updated 2 years ago
- Portfolio Site☆22Dec 28, 2025Updated 10 months ago
- ReactTS/FastAPI template☆24May 23, 2026Updated 5 months ago
- Set of tools helping developers to build TEE-enabled application quicker.☆16Aug 22, 2025Updated last year
- ☆19May 27, 2023Updated 3 years ago
- A Covid-19 data pipeline on AWS featuring PySpark/Glue, Docker, Great Expectations, Airflow, and Redshift, templated in CloudFormation an…☆24Nov 21, 2023Updated 2 years ago
Are these results useful?