NYCPlanning / data-engineering
Primary repository for NYC DCP's Data Engineering team
☆27Updated this week
Alternatives and similar repositories for data-engineering:
Users that are interested in data-engineering are comparing it to the libraries listed below
- Arcane Insight is a data analytics project designed to harness the power of SQLMesh & DuckDB to collect, transform, and analyze data from…☆33Updated 2 months ago
- Nicely modeled data built on the Github Archive.☆63Updated last year
- ☆17Updated 7 months ago
- Make dbt great again! Enables end user to extend dbt to his/her needs☆60Updated 3 weeks ago
- Using DuckDB with AWS Lambda to process Delta Lake data☆23Updated 2 months ago
- ☆73Updated 2 weeks ago
- CalData infrastructure☆13Updated last week
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆78Updated last year
- Cal-ITP data infrastructure☆58Updated this week
- Data-aware orchestration with dagster, dbt, and airbyte☆31Updated 2 years ago
- ☆15Updated 4 months ago
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆11Updated 10 months ago
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆49Updated 4 months ago
- ☆36Updated 9 months ago
- Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principle…☆83Updated this week
- The Modern Data Stack in a (Smaller) Box☆12Updated 2 years ago
- Dagster SQLMesh Adapter☆44Updated this week
- Ibis Basics: An Introduction to the Portable Python Dataframe Library.☆10Updated 9 months ago
- Department of Education (DOE) for New South Wales (AUS) data stack in a box☆32Updated 4 months ago
- Generate DBT tests based on sample data☆36Updated last year
- Example projects built on MotherDuck☆25Updated last month
- Repo for orienting dbt users to the Dagster asset framework☆54Updated 2 years ago
- dbt starter code for enterprise Snowflake usage data artifacts☆22Updated 2 years ago
- A new Airflow Provider for Fivetran, maintained by Astronomer and Fivetran☆22Updated 3 weeks ago
- fst: flow state tool | smooth where you want it, friction where you need it when data engineering☆34Updated last year
- Data models for Hubspot built using dbt.☆34Updated 3 weeks ago
- ☆19Updated 5 months ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset☆39Updated 4 months ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆27Updated 2 years ago
- ☆54Updated 8 months ago