Resources and projects from Udacity Data Engineering with AWS nano degree programme
☆30Apr 12, 2023Updated 3 years ago
Alternatives and similar repositories for Data-Engineering-With-AWS
Users that are interested in Data-Engineering-With-AWS are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is a real-life, high throughput streaming ELT data pipeline for ecommerce☆15May 22, 2023Updated 3 years ago
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆15Jun 26, 2023Updated 3 years ago
- Data Engineering Project in GCP☆23Mar 29, 2023Updated 3 years ago
- My first attempt at a rough ETL pipeline; technologies include spark, GCS, prefect orchestration, and terraform☆14Oct 12, 2022Updated 3 years ago
- This repo is mostly created for pyspark and hive related interview questions.☆64Jan 6, 2026Updated 9 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- 🚀 A structured data pipeline project using dbt and Snowflake to transform raw data into curated datasets. This project covers data inges…☆14Mar 17, 2025Updated last year
- Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…☆81Sep 2, 2023Updated 3 years ago
- This repo contains my projects from the Udacity Data Engineering Nano degree☆14Apr 26, 2023Updated 3 years ago
- ☆16Jul 15, 2023Updated 3 years ago
- Data Pipeline from the Global Historical Climatology Network DataSet☆27Dec 20, 2022Updated 3 years ago
- End-to-End examples that show how to solve business problems using Amazon SageMaker and it's ML/DL algorithm.☆17Jun 12, 2023Updated 3 years ago
- Databricks. Data Engineering with Databricks☆18Feb 27, 2024Updated 2 years ago
- A python library to generate competition brackets☆11Mar 23, 2021Updated 5 years ago
- Easily put your django site behind a layer of Basic Authentication, for protecting the staging/testing servers☆13Apr 26, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆11Nov 18, 2022Updated 3 years ago
- ☆21Mar 26, 2025Updated last year
- Full-stack OpenTelemetry observability for Apache Spark☆20Updated this week
- Case Study's from Danny Ma's Serious SQL Course☆19Aug 4, 2022Updated 4 years ago
- Docktor is a Web App that deploys an easy-to-use kit of analysis and scanning tools.☆13Nov 1, 2023Updated 2 years ago
- Simple ETL pipeline using Python☆29May 22, 2023Updated 3 years ago
- Complete Guide To Mastering Databricks☆66Feb 28, 2026Updated 7 months ago
- Master's thesis on Big Data☆35Aug 14, 2022Updated 4 years ago
- ☆23Sep 25, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆30Nov 16, 2023Updated 2 years ago
- ☆24Jan 18, 2025Updated last year
- AI agent in Javascript from Scratch without any frameworks!☆19Jan 20, 2025Updated last year
- End to end data pipeline to extract and analyze submissions from any subreddit using Pushshift, python, dbt and BigQuery.☆12Jul 17, 2023Updated 3 years ago
- Rust And Delta Demo. Explanation and walkthrough on delta-rs☆10Aug 21, 2023Updated 3 years ago
- Final Project for Data Engineering Zoomcamp Course 2024 🧙🔥☆11Apr 17, 2024Updated 2 years ago
- A Python Snowpark CLI for loading the TPC-DI dataset into Snowflake. Additional dbt models for building the data warehouse.☆11Sep 4, 2025Updated last year
- Data Engineering Project to Extract and Process Solana Reddit Data☆40Feb 3, 2024Updated 2 years ago
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆40Dec 18, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Deployed an kafka instance in AWS EC2 Instance to streamline the data into Databricks☆10Aug 15, 2023Updated 3 years ago
- RustBuy is a simple command-line interface (CLI) e-commerce application built in Rust, designed specifically to help you understand and p…☆20Sep 26, 2025Updated last year
- An example project that implements a data pipeline using Scala, Akka, and Spark and works with document-oriented and graph databases to l…☆11Aug 9, 2019Updated 7 years ago
- Sync's ArcPro to Google Earth☆13Apr 24, 2019Updated 7 years ago
- ☆57May 28, 2026Updated 4 months ago
- ☆11Jul 13, 2020Updated 6 years ago
- ☆28Jun 14, 2022Updated 4 years ago