VincenzoGalante / magic-the-gathering
A complete pipeline to pull data from Scryfall's "Magic: The Gathering"-API, via Prefect orchestration and dbt transformation.
☆38Updated last year
Related projects ⓘ
Alternatives and complementary repositories for magic-the-gathering
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆241Updated 4 months ago
- ☆16Updated last year
- Project for "Data pipeline design patterns" blog.☆41Updated 3 months ago
- Sample project to demonstrate data engineering best practices☆166Updated 8 months ago
- Code for my "Efficient Data Processing in SQL" book.☆50Updated 3 months ago
- End to end data engineering project☆51Updated 2 years ago
- Simple stream processing pipeline☆92Updated 5 months ago
- ☆30Updated last year
- Code for dbt tutorial☆143Updated 5 months ago
- Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard.☆197Updated last year
- Data Engineering examples for Airflow, Prefect, and Mage.ai; dbt for BigQuery, Redshift, ClickHouse, PostgreSQL; Spark/PySpark for Batch …☆51Updated last week
- Code Repository for my 1st Data Project.☆21Updated last year
- Hey this is the repo that has all the queries and data for my video game training series!☆133Updated 2 years ago
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆112Updated 4 months ago
- Template for Data Engineering and Data Pipeline projects☆104Updated last year
- Code for "Advanced data transformations in SQL" free live workshop☆66Updated last month
- Data pipeline that scrapes Rust cheater Steam profiles☆51Updated 2 years ago
- Code for "Efficient Data Processing in Spark" Course☆247Updated last month
- Near real time ETL to populate a dashboard.☆70Updated 5 months ago
- My notes of the Data Engineering Zoomcamp by DataTalksClub☆32Updated last year
- ☆128Updated last year
- Code for the Data Engineering Zoomcamp☆48Updated last year
- ☆66Updated last month
- My first attempt at a rough ETL pipeline; technologies include spark, GCS, prefect orchestration, and terraform☆14Updated 2 years ago
- ☆132Updated 2 years ago
- With everything I learned from DEZoomcamp from datatalks.club, this project performs a batch processing on AWS for the cycling dataset wh…☆12Updated 2 years ago
- ☆94Updated 2 years ago
- This repository goes over how to handle massive variety in data engineering☆121Updated last year
- Example repo to create end to end tests for data pipeline.☆21Updated 5 months ago
- Data Engineering Project to Extract and Process Solana Reddit Data☆23Updated 9 months ago