NYCPlanning / data-engineeringLinks
Primary repository for NYC DCP's Data Engineering team
☆30Updated this week
Alternatives and similar repositories for data-engineering
Users that are interested in data-engineering are comparing it to the libraries listed below
Sorting:
- CalData infrastructure☆21Updated 2 weeks ago
- ☆78Updated last week
- Arcane Insight is a data analytics project designed to harness the power of SQLMesh & DuckDB to collect, transform, and analyze data from…☆34Updated 6 months ago
- Cal-ITP data infrastructure☆65Updated this week
- Nicely modeled data built on the Github Archive.☆67Updated last year
- Example projects built on MotherDuck☆29Updated last month
- ☆150Updated 2 months ago
- Department of Education (DOE) for New South Wales (AUS) data stack in a box☆34Updated 9 months ago
- Demo Project for Open Source MDS☆168Updated 2 months ago
- Data-aware orchestration with dagster, dbt, and airbyte☆30Updated 2 years ago
- ☆41Updated last year
- ☆18Updated last year
- A "modern" Strava data pipeline fueled by dlt, duckdb, dbt, and evidence.dev☆34Updated 3 months ago
- Cookiecutter template for creating GitHub Actions orchestrated Meltano projects☆27Updated 3 years ago
- Containerized end-to-end analytics of Spotify data using Python, dbt, Postgres, and Metabase☆131Updated 3 years ago
- Generate DBT tests based on sample data☆38Updated last year
- [DEPRECATED] A dbt adapter for Excel.☆95Updated 4 months ago
- Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principle…☆115Updated 4 months ago
- 📦 Serverless and local-first Open Data Platform☆294Updated last week
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆52Updated 9 months ago
- This repo contains information about DuckDB extensions found on GitHub. Refreshed daily☆101Updated this week
- Using DuckDB with AWS Lambda to process Delta Lake data☆28Updated 6 months ago
- Make dbt docs and Apache Superset talk to one another☆147Updated 7 months ago
- ☆17Updated 8 months ago
- A serverless duckDB deployment at GCP☆40Updated 2 years ago
- 🏁 A sweet and speedy code generator for dbt 🏎️✨☆29Updated 3 weeks ago
- A dbt-Core package for generating models from an activity stream.☆43Updated last year
- Jupyter Cell / Line Magics for DuckDB☆51Updated last month
- Slow & local data allows you to move fast and deliver business value for the 99.9% of the data challenges.☆273Updated 4 months ago
- Repo for orienting dbt users to the Dagster asset framework☆54Updated 2 years ago