A collection of Data Engineering projects using different cloud providers. Explore real-world implementations of data pipelines, transformations, and workflows in cloud environments.
☆17Apr 7, 2025Updated last year
Alternatives and similar repositories for data_engineering_projects
Users that are interested in data_engineering_projects are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Python Script To Convert XLS Or XLSX to CSV.☆12Sep 7, 2017Updated 8 years ago
- An end-to-end open-source data stack for crawling and visualizing real estate data, facilitating insights into market trends.☆15Mar 16, 2026Updated 4 months ago
- Template to deploy Metabase service on Google Cloud Run☆20Jul 1, 2021Updated 5 years ago
- This repo contains DAGs demonstrating a variety of ELT patterns using Airflow along with dbt.☆12Jan 12, 2023Updated 3 years ago
- Guideline to extract table lineage info in OpenLineage format from access history view☆14May 11, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Ontology Catalog in SQL to use with Timbr Intelligent Semantic Layer☆20Sep 8, 2025Updated 10 months ago
- An e2e pipeline using dlt, dagster, duckdb, and dbt-core☆23Mar 27, 2026Updated 3 months ago
- Metabase Teradata Driver shipped as 3rd party plugin☆14May 28, 2026Updated last month
- Dashboard showcasing Conjoint Analysis for the Electric Vehicle Lease Market (as at January 2020) in San Francisco☆15Feb 19, 2020Updated 6 years ago
- ☆14May 17, 2025Updated last year
- python library for Nexon OpenAPI☆13Jul 13, 2024Updated 2 years ago
- Open Source Kafka Connect Connector plugin repository built and maintained by Instaclustr☆12May 13, 2026Updated 2 months ago
- ☆11Apr 16, 2022Updated 4 years ago
- A ml project to classify the sentiment of youtube comments☆51Nov 25, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Spring WebFlux with coroutines support and suspending kafka message dispatch.☆12Oct 16, 2019Updated 6 years ago
- This demo shows how to capture data changes from relational databases (Oracle and PostgreSQL) and stream them to Confluent Cloud, use ksq…☆17Jan 10, 2025Updated last year
- DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics control framework that can be used to monitor, log, aud…☆29Feb 14, 2026Updated 5 months ago
- Documentation repository for the Egeria project.☆24Updated this week
- Korean localized SageMaker Studio workshop materials for hands-on labs.☆16Sep 10, 2020Updated 5 years ago
- Cloud-native Trino (prestosql) + Hive + Minio + Superset☆23Nov 29, 2021Updated 4 years ago
- Example project for working with mysql driver☆19Aug 9, 2023Updated 2 years ago
- ☆16Oct 3, 2025Updated 9 months ago
- Self-hosted web app for Cloudflare R2 buckets. Supports drag-and-drop uploads, batch copy/move/delete, multi-file ZIP downloads, signed s…☆45Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Example of how to use Remote Views in Vue.js☆10Mar 11, 2018Updated 8 years ago
- This repository aims to show how a stateful Java Service can be deployed on EKS☆15Mar 12, 2024Updated 2 years ago
- Live Streaming with LiveView and Mux☆14Sep 24, 2020Updated 5 years ago
- Symfony2 Admin panel in 30 seconds?☆12Jun 20, 2015Updated 11 years ago
- ☆16Jul 10, 2025Updated last year
- How to integrate PeerJs into node-webkit/NW.js app☆11Jun 16, 2015Updated 11 years ago
- Pinterest's simplified and efficient Tiered Storage implementation for Kafka☆26May 13, 2026Updated 2 months ago
- ☆17Jun 27, 2019Updated 7 years ago
- ☆10Apr 3, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆12Feb 26, 2021Updated 5 years ago
- Infinispan Embedded Tutorial☆19Jun 16, 2021Updated 5 years ago
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆47Mar 7, 2024Updated 2 years ago
- ☆26Oct 30, 2022Updated 3 years ago
- Dankook University RocksDB research/study☆17Aug 30, 2021Updated 4 years ago
- portfolio☆26Updated this week
- A module for reading, writing, and manipulating JSON files☆11Sep 25, 2018Updated 7 years ago