Primary repository for NYC DCP's Data Engineering team
☆43Oct 12, 2026Updated this week
Alternatives and similar repositories for data-engineering
Users that are interested in data-engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Google App Scripts that sends a number of emails from the specific number and that tracks the open status of each email☆17Dec 11, 2024Updated last year
- Data pipelines for datasets that are part of the Recovery Data Partnership project☆12Oct 26, 2022Updated 3 years ago
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆13May 24, 2024Updated 2 years ago
- Code to demonstrate data engineering metadata & logging best practices☆21Mar 12, 2024Updated 2 years ago
- ☆16Apr 26, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Repo for CDC with debezium blog post☆32Sep 15, 2024Updated 2 years ago
- Inspection data and PDFs from the USDA's Animal and Plant Health Inspection Service.☆18Updated this week
- This repository contains the necessary configuration files and DAGs (Directed Acyclic Graphs) for setting up a robust data engineering en…☆25Jan 26, 2024Updated 2 years ago
- Machine-readable, reconciled NYC Council adopted-budget data (Schedule C, Terms & Conditions, Capital) for FY2025-FY2027. Source docs © C…☆19Aug 30, 2026Updated last month
- Open-source platform connecting AI assistants to government open data — MCP server, curated civic MCP directory, and anti-hallucination f…☆41Oct 2, 2026Updated last week
- Cost Efficient Data Pipelines with DuckDB☆63May 14, 2025Updated last year
- Example repo to create end to end tests for data pipeline.☆25Jun 14, 2024Updated 2 years ago
- Code for data quality with greatexpectations blog☆14Jul 30, 2024Updated 2 years ago
- Python bindings for NYC Geosupport Desktop☆17Sep 11, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Repository for Data Engineering Interview Series☆42Oct 17, 2024Updated last year
- Cal-ITP data infrastructure☆73Updated this week
- CalData's MDSA project with Caltrans on Performance Measurement System (PeMS) data☆13Aug 19, 2025Updated last year
- Commuting zones are geographic areas where people live and work and are useful for understanding local economies, as well as how they dif…☆44Mar 29, 2026Updated 6 months ago
- Place for sharing quick reports, and works in progress☆35Oct 2, 2026Updated last week
- A machine-readable format for storing and sharing water rate structures.☆26Oct 22, 2020Updated 5 years ago
- A studio for OpenStreetMap development & deisgn☆14Aug 11, 2025Updated last year
- Tools for creating, exploring, and validating GeoZarr data☆30Updated this week
- Arduino for AT90USB1286☆15Jun 2, 2014Updated 12 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Quizdown extension for HTML in Quarto☆15Apr 12, 2025Updated last year
- Tools for working with types where a subset of values has a total order, like e.g. floats without NaN☆13Nov 7, 2025Updated 11 months ago
- Manage multiple dat instances on a single machine☆14Mar 29, 2016Updated 10 years ago
- Common GitHub actions and workflows for maintaining dbt☆16Aug 27, 2026Updated last month
- High-speed PII masking as a Polars plugin, powered by Rust☆21Aug 30, 2026Updated last month
- "rust-openai-chatgpt-api" is a Rust library for accessing the ChatGPT API, a powerful NLP platform by OpenAI. The library provides a simp…☆11Jul 19, 2026Updated 2 months ago
- A tool for creating pivot tables from the command line.☆14Mar 16, 2023Updated 3 years ago
- Rust tools for working with CSV files: scrubcsv, catcsv, fixed2csv, geochunk, hashcsv.☆19Jan 17, 2026Updated 8 months ago
- My personal blog☆16Oct 5, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code for "Advanced data transformations in SQL" free live workshop☆95May 5, 2025Updated last year
- Source code and logic to build Luau for Rust☆11Sep 27, 2026Updated 2 weeks ago
- Streaming audio reactivity in the browser using WebRTC + Web Audio API☆12Nov 17, 2014Updated 11 years ago
- Project for "Data pipeline design patterns" blog.☆54Aug 6, 2024Updated 2 years ago
- A writer for object file ar archives☆16Jul 31, 2026Updated 2 months ago
- Communicate with OpenAi's GPT3.5 and GPT4 (ChatGPT) API.☆11Apr 7, 2023Updated 3 years ago
- CKAN Issues Extension☆14Sep 16, 2021Updated 5 years ago