Primary repository for NYC DCP's Data Engineering team
☆43Sep 2, 2026Updated this week
Alternatives and similar repositories for data-engineering
Users that are interested in data-engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Dec 11, 2023Updated 2 years ago
- Google App Scripts that sends a number of emails from the specific number and that tracks the open status of each email☆17Dec 11, 2024Updated last year
- A custom end-to-end analytics platform for customer churn☆10May 15, 2025Updated last year
- Data pipelines for datasets that are part of the Recovery Data Partnership project☆12Oct 26, 2022Updated 3 years ago
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆13May 24, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code to demonstrate data engineering metadata & logging best practices☆21Mar 12, 2024Updated 2 years ago
- Code for blog at: https://www.startdataengineering.com/post/docker-for-de/☆39Apr 29, 2024Updated 2 years ago
- ☆16Apr 26, 2024Updated 2 years ago
- Repo for CDC with debezium blog post☆32Sep 15, 2024Updated last year
- Machine-readable, reconciled NYC Council adopted-budget data (Schedule C, Terms & Conditions, Capital) for FY2025-FY2027. Source docs © C…☆19Updated this week
- Open-source platform connecting AI assistants to government open data — MCP server, curated civic MCP directory, and anti-hallucination f…☆42Aug 27, 2026Updated last week
- Cost Efficient Data Pipelines with DuckDB☆63May 14, 2025Updated last year
- A platform for impacted communities to understand their local air quality and advocate for environmental justice.☆29Apr 12, 2023Updated 3 years ago
- Example repo to create end to end tests for data pipeline.☆25Jun 14, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Code for data quality with greatexpectations blog☆14Jul 30, 2024Updated 2 years ago
- Python bindings for NYC Geosupport Desktop☆17Sep 11, 2025Updated 11 months ago
- Repository for Data Engineering Interview Series☆41Oct 17, 2024Updated last year
- Cal-ITP data infrastructure☆71Updated this week
- CalData's MDSA project with Caltrans on Performance Measurement System (PeMS) data☆13Aug 19, 2025Updated last year
- Place for sharing quick reports, and works in progress☆35Updated this week
- A machine-readable format for storing and sharing water rate structures.☆25Oct 22, 2020Updated 5 years ago
- A studio for OpenStreetMap development & deisgn☆14Aug 11, 2025Updated last year
- Tools for creating, exploring, and validating GeoZarr data☆29Jun 15, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Step by step instructions to create a production-ready data pipeline☆67Jul 9, 2026Updated last month
- Tools for working with types where a subset of values has a total order, like e.g. floats without NaN☆13Nov 7, 2025Updated 9 months ago
- Manage multiple dat instances on a single machine☆14Mar 29, 2016Updated 10 years ago
- Common GitHub actions and workflows for maintaining dbt☆16Updated this week
- "rust-openai-chatgpt-api" is a Rust library for accessing the ChatGPT API, a powerful NLP platform by OpenAI. The library provides a simp…☆11Jul 19, 2026Updated last month
- High-speed PII masking as a Polars plugin, powered by Rust☆20Updated this week
- A tool for creating pivot tables from the command line.☆14Mar 16, 2023Updated 3 years ago
- Rust tools for working with CSV files: scrubcsv, catcsv, fixed2csv, geochunk, hashcsv.☆19Jan 17, 2026Updated 7 months ago
- Analytics engineering with dbt - projects and developer environment☆24Sep 27, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code for "Advanced data transformations in SQL" free live workshop☆94May 5, 2025Updated last year
- Streaming audio reactivity in the browser using WebRTC + Web Audio API☆12Nov 17, 2014Updated 11 years ago
- Visualizing data to better monitor issues around food security☆14Nov 28, 2024Updated last year
- A writer for object file ar archives☆16Jul 31, 2026Updated last month
- Source code and logic to build LuaJIT 2.1 for Rust☆21Updated this week
- Transit benefits enrollment, minus the paperwork.☆37Updated this week
- Prints numbers with separators☆14Apr 29, 2021Updated 5 years ago