A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.
☆138Apr 18, 2020Updated 6 years ago
Alternatives and similar repositories for Skytrax-Data-Warehouse
Users that are interested in Skytrax-Data-Warehouse are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A way for home buyers to know about factors affecting a state☆48Mar 2, 2019Updated 7 years ago
- Tracking and measuring neighborhood and district-level eviction rates in the city of San Francisco.☆141Jul 14, 2020Updated 6 years ago
- Airflow ETL for Meetup API☆44Dec 27, 2018Updated 7 years ago
- Udacity Data Engineering Nanodegree Project 3☆11Jul 14, 2019Updated 7 years ago
- An open source enterprise data warehousing and analysis platform.☆24Nov 8, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆15Jun 26, 2023Updated 3 years ago
- Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…☆14May 25, 2023Updated 3 years ago
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆167Jun 16, 2020Updated 6 years ago
- Beginner data engineering project - batch edition☆615Apr 13, 2026Updated 6 months ago
- RedditR for Content Engagement and Recommendation☆18Dec 21, 2017Updated 8 years ago
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆49Aug 23, 2019Updated 7 years ago
- Use AWS Lambda to Pull E-Scooter and E-Bike Location Data, store in S3 & Redshift using Data Vault Data Model, Server to Google Data Stud…☆16Jun 12, 2022Updated 4 years ago
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆89Nov 22, 2021Updated 4 years ago
- End-to-end ELT pipeline project with semantic layer implementation using dbt and Cube.js☆10Nov 27, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆10May 24, 2021Updated 5 years ago
- A collection of data analysis projects done using PySpark via Jupyter notebooks.☆10Oct 8, 2022Updated 4 years ago
- Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake developme…☆2,026Aug 26, 2022Updated 4 years ago
- An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.☆1,552Mar 9, 2020Updated 6 years ago
- Example end to end data engineering project.☆1,448Dec 8, 2022Updated 3 years ago
- Educational project on how to build an ETL (Extract, Transform, Load) data pipeline, orchestrated with Airflow.☆355Jan 12, 2022Updated 4 years ago
- Data Engineering infrastructure that controls inbound tabular data file feeds and validates data contracts☆18Updated this week
- An end-to-end data engineering pipeline to create a dashboard for the latest content on the r/Stocks subreddit☆20Aug 5, 2022Updated 4 years ago
- A template for Python projects that need to use a relational database, including tooling for managing schema migrations and testing again…☆13Dec 13, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Run greatexpectations.io on ANY SQL Engine using REST API. Supported by FastAPI, Pydantic and SQLAlchemy as best data quality tool☆15Dec 12, 2025Updated 10 months ago
- Data Engineering pipeline hosted entirely in the AWS ecosystem utilizing DocumentDB as the database☆14Oct 26, 2021Updated 5 years ago
- A platform-agnostic index of Singer.io taps and targets.☆11Jan 29, 2021Updated 5 years ago
- 实时数据仓库搭建☆16Sep 7, 2019Updated 7 years ago
- Business Intelligence and Data Warehousing Project☆12Dec 4, 2019Updated 6 years ago
- Example project for consuming AWS Kinesis streamming and save data on Amazon Redshift using Apache Spark☆12May 22, 2018Updated 8 years ago
- ☆196Feb 25, 2022Updated 4 years ago
- Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development☆22Jul 9, 2019Updated 7 years ago
- ☆52Jul 15, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on lambda architecture, that aggrega…☆507Aug 24, 2022Updated 4 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29May 2, 2023Updated 3 years ago
- My Portfolio of all the projects I did for both my Udacity Data Engineer and Data Streaming Nanodegrees☆20Jul 16, 2020Updated 6 years ago
- pyspark methods to enhance developer productivity 📣 👯 🎉☆691Oct 25, 2026Updated last week
- Building a responsive personal portfolio website adaptable to all devices, with ui components and animated interactions.☆14Jul 13, 2025Updated last year
- Personal Data Engineering Projects☆1,046Feb 8, 2023Updated 3 years ago
- Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…☆58Oct 20, 2022Updated 4 years ago