🦆 Batch data pipeline with Airflow, DuckDB, Delta Lake, Trino, MinIO, and Metabase. Full observability and data quality.
☆86Nov 5, 2025Updated 5 months ago
Alternatives and similar repositories for batch-data-pipeline
Users that are interested in batch-data-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Mar 29, 2024Updated 2 years ago
- ☆12May 28, 2024Updated last year
- Cutting-edge, opinionated, and ambitious project builder for power users and researchers.☆16Feb 2, 2026Updated 2 months ago
- ☆13Feb 20, 2026Updated last month
- ☆15Aug 18, 2021Updated 4 years ago
- Deploy open-source AI quickly and easily - Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- An Objective-C library for uploading shots to Dribbble.☆13Mar 27, 2012Updated 14 years ago
- markup to create labs for courses from the Google Cloud training catalog.☆49Sep 15, 2025Updated 7 months ago
- Upload shots to dribbble.com☆14Mar 27, 2012Updated 14 years ago
- ☆26Aug 21, 2025Updated 7 months ago
- Data Engineering Projects using Mage.ai as orchestrator☆18Jan 20, 2026Updated 2 months ago
- A testing ground for Plotly Dash app development including app features and experimenting with dashboard visualizations.☆10Oct 15, 2023Updated 2 years ago
- NSCollectionView sample for OS X 10.11 ElCapitan☆12Nov 24, 2017Updated 8 years ago
- Use MobileNet SSD and openCV to detect and count car on road☆11Jan 13, 2020Updated 6 years ago
- ☆10Jul 19, 2020Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Deploy a complete data stack in just a couple of minutes.☆15Mar 6, 2024Updated 2 years ago
- Multi-threaded simple proxy server in Python with file caching☆11Oct 4, 2020Updated 5 years ago
- ☆12Sep 23, 2023Updated 2 years ago
- A sophisticated exploration of dbt macro capabilities, pushing the boundaries of what's possible with dbt's macro system.☆18Feb 4, 2026Updated 2 months ago
- End-to-end data platform: A PoC Data Platform project utilizing modern data stack (Spark, Airflow, DBT, Trino, Lightdash, Hive metastore,…☆48Oct 14, 2024Updated last year
- ☆16Apr 18, 2025Updated 11 months ago
- ☆11Nov 21, 2023Updated 2 years ago
- um its my portfolio?☆16Feb 10, 2026Updated 2 months ago
- ☆15Dec 12, 2025Updated 4 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Real-time Credit card Fraud detection using Spark Streaming, Spark ML, Spark SQL, Kafka, Cassandra and Airflow☆11Jul 1, 2022Updated 3 years ago
- ☆16Nov 27, 2025Updated 4 months ago
- An example of a project generated with cookiecutter-uv☆15Updated this week
- ☆14Dec 28, 2023Updated 2 years ago
- http://archive.ics.uci.edu/ml/index.html☆12Jan 25, 2020Updated 6 years ago
- ☆18May 27, 2025Updated 10 months ago
- ☆11Jan 31, 2019Updated 7 years ago
- Content for O'Reilly Live Training☆25Sep 22, 2024Updated last year
- ☆22Mar 15, 2011Updated 15 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Miscellaneous codes and writings for MLOps☆15Apr 8, 2026Updated last week
- This project demonstrates how to integrate DuckLake, SQLMesh, and Neon PostgreSQL to create a modern data lakehouse architecture with ver…☆28Jun 3, 2025Updated 10 months ago
- Interactive web-based dashboard to manage traffic flow using YOLOX, DeepSORT☆11Jul 30, 2022Updated 3 years ago
- Create and Run 🚀 Dotfiles projects for Windows 10/11☆23Jan 26, 2025Updated last year
- General Assembly's Data Science Immersive Capstone Project☆13Sep 9, 2021Updated 4 years ago
- Machine Learning Model and Deployment for Classification of Mango Varieties☆10Dec 22, 2022Updated 3 years ago
- A local-first, terminal-based password manager built for people who care about security, simplicity, and control☆37Dec 31, 2025Updated 3 months ago