Primary repository for NYC DCP's Data Engineering team
☆42Jul 23, 2026Updated this week
Alternatives and similar repositories for data-engineering
Users that are interested in data-engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Dec 11, 2023Updated 2 years ago
- Google App Scripts that sends a number of emails from the specific number and that tracks the open status of each email☆17Dec 11, 2024Updated last year
- Data pipelines for datasets that are part of the Recovery Data Partnership project☆12Oct 26, 2022Updated 3 years ago
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆13May 24, 2024Updated 2 years ago
- Code to demonstrate data engineering metadata & logging best practices☆22Mar 12, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Code for blog at: https://www.startdataengineering.com/post/docker-for-de/☆39Apr 29, 2024Updated 2 years ago
- ☆16Apr 26, 2024Updated 2 years ago
- This is a GAS application for rearranging Google Apps Scripts (GAS) in a project which can be seen at the script editor.☆16Apr 14, 2018Updated 8 years ago
- Inspection data and PDFs from the USDA's Animal and Plant Health Inspection Service.☆18Updated this week
- This repository contains the necessary configuration files and DAGs (Directed Acyclic Graphs) for setting up a robust data engineering en…☆25Jan 26, 2024Updated 2 years ago
- Open-source platform connecting AI assistants to government open data — MCP server, curated civic MCP directory, and anti-hallucination f…☆37Jul 12, 2026Updated last week
- Cost Efficient Data Pipelines with DuckDB☆61May 14, 2025Updated last year
- Example repo to create end to end tests for data pipeline.☆25Jun 14, 2024Updated 2 years ago
- Python bindings for NYC Geosupport Desktop☆17Sep 11, 2025Updated 10 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Repository for Data Engineering Interview Series☆41Oct 17, 2024Updated last year
- Cal-ITP data infrastructure☆69Updated this week
- CalData's MDSA project with Caltrans on Performance Measurement System (PeMS) data☆13Aug 19, 2025Updated 11 months ago
- Commuting zones are geographic areas where people live and work and are useful for understanding local economies, as well as how they dif…☆45Mar 29, 2026Updated 3 months ago
- A full text and metadata extractor for CKAN☆19Nov 21, 2018Updated 7 years ago
- A machine-readable format for storing and sharing water rate structures.☆24Oct 22, 2020Updated 5 years ago
- a website for seeing data of nyc's citibike stations☆26Jul 18, 2026Updated last week
- Tools for creating, exploring, and validating GeoZarr data☆28Jun 15, 2026Updated last month
- Quizdown extension for HTML in Quarto☆15Apr 12, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Tools for working with types where a subset of values has a total order, like e.g. floats without NaN☆13Nov 7, 2025Updated 8 months ago
- Manage multiple dat instances on a single machine☆14Mar 29, 2016Updated 10 years ago
- Common GitHub actions and workflows for maintaining dbt☆16May 30, 2026Updated last month
- High-speed PII masking as a Polars plugin — powered by Rust☆18Jul 8, 2026Updated 2 weeks ago
- GeoGuessr for Subway Systems☆29Aug 18, 2024Updated last year
- A tool for creating pivot tables from the command line.☆14Mar 16, 2023Updated 3 years ago
- Rust tools for working with CSV files: scrubcsv, catcsv, fixed2csv, geochunk, hashcsv.☆19Jan 17, 2026Updated 6 months ago
- Analytics engineering with dbt - projects and developer environment☆22Sep 27, 2024Updated last year
- Code for "Advanced data transformations in SQL" free live workshop☆93May 5, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Source code and logic to build Luau for Rust☆11Jul 5, 2026Updated 2 weeks ago
- Streaming audio reactivity in the browser using WebRTC + Web Audio API☆12Nov 17, 2014Updated 11 years ago
- Project for "Data pipeline design patterns" blog.☆53Aug 6, 2024Updated last year
- Visualizing data to better monitor issues around food security☆14Nov 28, 2024Updated last year
- Figures out the local timezone as IANA / Olson identifier☆15Apr 8, 2024Updated 2 years ago
- A writer for object file ar archives☆15Jun 9, 2026Updated last month
- Source code and logic to build LuaJIT 2.1 for Rust☆20May 30, 2026Updated last month