VincenzoGalante / magic-the-gathering
A complete pipeline to pull data from Scryfall's "Magic: The Gathering"-API, via Prefect orchestration and dbt transformation.
☆40Updated last year
Alternatives and similar repositories for magic-the-gathering:
Users that are interested in magic-the-gathering are comparing it to the libraries listed below
- ☆17Updated 2 years ago
- Project for "Data pipeline design patterns" blog.☆45Updated 8 months ago
- Sample project to demonstrate data engineering best practices☆186Updated last year
- Code for the Data Engineering Zoomcamp☆47Updated last year
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 8 months ago
- ☆34Updated last year
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆67Updated last year
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆137Updated 9 months ago
- Code for dbt tutorial☆156Updated 10 months ago
- Pipeline that extracts data from the Spotify API to build a more detailed version of Spotify Wrapped☆35Updated last year
- End to end data engineering project☆54Updated 2 years ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆82Updated last year
- Containerized end-to-end analytics of Spotify data using Python, dbt, Postgres, and Metabase☆126Updated 2 years ago
- Processing TfL data for bike usage with Google Cloud Platform.☆45Updated 2 years ago
- ☆28Updated last year
- ☆114Updated 8 months ago
- Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; K…☆65Updated 2 months ago
- Code for "Advanced data transformations in SQL" free live workshop☆78Updated 6 months ago
- An end-to-end data pipeline which extracts divvy bikeshare data from web loads it into data lake and datawarehouse transforms it using db…☆35Updated last year
- Data engineering with dbt, published by Packt☆77Updated last year
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆260Updated 9 months ago
- Course notes for the Astronomer Certification DAG Authoring for Apache Airflow☆52Updated last year
- Data Pipeline from the Global Historical Climatology Network DataSet☆27Updated 2 years ago
- Near real time ETL to populate a dashboard.☆73Updated 10 months ago
- Data pipeline that scrapes Rust cheater Steam profiles☆52Updated 3 years ago
- Data pipeline with dbt, Airflow, Great Expectations☆162Updated 3 years ago
- In this repository we store all materials for dlt workshops, courses, etc.☆155Updated last week
- Master's thesis on Big Data☆34Updated 2 years ago
- Analysis of 311 Service Requests for the City of NYC (from 2010 to 2023) Tech: Prefect cloud, dbt core, BigQuery, Compute Engine, CloudRu…☆20Updated 2 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆87Updated 4 years ago