A collection of Data Engineering projects using different cloud providers. Explore real-world implementations of data pipelines, transformations, and workflows in cloud environments.
☆17Apr 7, 2025Updated last year
Alternatives and similar repositories for data_engineering_projects
Users that are interested in data_engineering_projects are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- End-to-end data engineer project☆24Aug 17, 2023Updated 3 years ago
- This repo contains DAGs demonstrating a variety of ELT patterns using Airflow along with dbt.☆12Jan 12, 2023Updated 3 years ago
- Guideline to extract table lineage info in OpenLineage format from access history view☆14May 11, 2023Updated 3 years ago
- Execute DBT core on cloud run☆22May 6, 2024Updated 2 years ago
- A Micronaut demo which shows how to use the Resilience4j☆13Jul 17, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An e2e pipeline using dlt, dagster, duckdb, and dbt-core☆24Mar 27, 2026Updated 5 months ago
- Dashboard showcasing Conjoint Analysis for the Electric Vehicle Lease Market (as at January 2020) in San Francisco☆15Feb 19, 2020Updated 6 years ago
- dbt adapter for Teradata☆30Jul 28, 2026Updated last month
- End-to-end ETL pipeline in the Microsoft Azure cloud - (Jun '24 - Jul '24)☆41Aug 9, 2024Updated 2 years ago
- A curated list of ML awesome frameworks & libraries for text data☆18Mar 14, 2023Updated 3 years ago
- Spring WebFlux with coroutines support and suspending kafka message dispatch.☆12Oct 16, 2019Updated 6 years ago
- This demo shows how to capture data changes from relational databases (Oracle and PostgreSQL) and stream them to Confluent Cloud, use ksq…☆17Jan 10, 2025Updated last year
- Heranow website and dashboard☆14Nov 13, 2024Updated last year
- Main server code for Django server and facial recognition verification☆12Sep 13, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Documentation repository for the Egeria project.☆24Updated this week
- ☆15Nov 15, 2018Updated 7 years ago
- ☆24Jun 18, 2026Updated 3 months ago
- A dashboard that supports fleet managers and decision makers to gain insights into their automotive fleets and optimize them☆13Mar 20, 2021Updated 5 years ago
- Agent Skill for building AI agents with Google's Agent Development Kit (ADK) in Python, Java, Go, and TypeScript☆18Aug 21, 2026Updated last month
- A kubernetes operator to deploy and auto-scale KafkaConnect Application.☆20Feb 25, 2023Updated 3 years ago
- Example project for working with mysql driver☆19Aug 9, 2023Updated 3 years ago
- Visual editor for jsonata☆25Oct 27, 2023Updated 2 years ago
- Examples from the book "Kubernetes in Action" by Marko Luksa☆15May 19, 2017Updated 9 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆12Jul 2, 2023Updated 3 years ago
- Transforms Databricks Unity Catalog tables into a materialized knowledge graph, with ontology design and reasoning exposed as tools via M…☆384Updated this week
- Live Streaming with LiveView and Mux☆14Sep 24, 2020Updated 6 years ago
- ☆17Oct 11, 2022Updated 3 years ago
- solutions for google foobar challenge questions☆10Feb 21, 2017Updated 9 years ago
- ☆15Apr 8, 2024Updated 2 years ago
- Getting started with InfluxDB with Python and MQTT☆11Jul 31, 2019Updated 7 years ago
- ☆16Jul 10, 2025Updated last year
- Flat-file based SMS gateway PHP class working with open source Android app☆21Sep 20, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Visualizing mortality linked with Mental Disorders☆13Oct 25, 2019Updated 6 years ago
- S3Compat API Test Suite☆19May 2, 2025Updated last year
- Chrome extension to turn pages into wireframes☆13Mar 25, 2020Updated 6 years ago
- Invoke AWS services directly from AWS AppSync via extended HTTP data source support.☆25Mar 12, 2020Updated 6 years ago
- 자바 코딩 문제집 소스 코드☆17Sep 16, 2022Updated 4 years ago
- Determining the important factors that influences the customer or passenger satisfaction of an airlines using CRISP-DM methodology in Pyt…☆28Sep 1, 2023Updated 3 years ago
- ☆17Jun 27, 2019Updated 7 years ago