Primary repository for NYC DCP's Data Engineering team
☆45Oct 30, 2026Updated this week
Alternatives and similar repositories for data-engineering
Users that are interested in data-engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Python or SQL for data transformation☆11Jul 4, 2024Updated 2 years ago
- ☆15Dec 11, 2023Updated 2 years ago
- A custom end-to-end analytics platform for customer churn☆10May 15, 2025Updated last year
- Google App Scripts that sends a number of emails from the specific number and that tracks the open status of each email☆17Dec 11, 2024Updated last year
- Data pipelines for datasets that are part of the Recovery Data Partnership project☆12Oct 26, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Repository for Data Engineering Interview Series☆42Oct 17, 2024Updated 2 years ago
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆13May 24, 2024Updated 2 years ago
- ☆16Apr 26, 2024Updated 2 years ago
- Code for blog at: https://www.startdataengineering.com/post/docker-for-de/☆39Apr 29, 2024Updated 2 years ago
- Repo for CDC with debezium blog post☆32Sep 15, 2024Updated 2 years ago
- Inspection data and PDFs from the USDA's Animal and Plant Health Inspection Service.☆18Updated this week
- Get BEA data, including vintage data☆11Dec 24, 2020Updated 5 years ago
- This repository contains the necessary configuration files and DAGs (Directed Acyclic Graphs) for setting up a robust data engineering en…☆25Jan 26, 2024Updated 2 years ago
- A quarto extension to add bootstrap accordion component☆12Apr 13, 2026Updated 6 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Checked NYC Council budget data: the Council's spreadsheets and NYC Open Data, plus Schedule C, transparency resolutions, the capital boo…☆19Oct 26, 2026Updated last week
- A data pipeline for the ingestion & visualisation of U.S Geological Survey Earthquake data☆14Jun 24, 2024Updated 2 years ago
- Example repo to create end to end tests for data pipeline.☆25Jun 14, 2024Updated 2 years ago
- Data Catalog Vocabulary (DCAT) - United States Profile Chief Data Officers Council & Federal Committee on Statistical Methodology☆76Apr 28, 2026Updated 6 months ago
- Repository showing how to automate data testing as part of CI☆12Jul 3, 2022Updated 4 years ago
- CalData's MDSA project with Caltrans on Performance Measurement System (PeMS) data☆13Oct 25, 2026Updated last week
- Presentations from the 2024 Fellowship.☆16Sep 17, 2024Updated 2 years ago
- Cost Efficient Data Pipelines with DuckDB☆63May 14, 2025Updated last year
- Code for Airflow 3.0 Tutorial☆15Apr 11, 2026Updated 6 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Place for sharing quick reports, and works in progress☆35Updated this week
- A full text and metadata extractor for CKAN☆19Nov 21, 2018Updated 7 years ago
- Advanced Spark SQL for Data Engineers☆14Jun 21, 2025Updated last year
- A Python package for extracting data and metadata from Esri REST API endpoints. It provides an API, CLI and web app for exporting feature…☆70Oct 15, 2026Updated 2 weeks ago
- Tools for creating, exploring, and validating GeoZarr data☆31Oct 6, 2026Updated 3 weeks ago
- Manage multiple dat instances on a single machine☆14Mar 29, 2016Updated 10 years ago
- Step by step instructions to create a production-ready data pipeline☆69Jul 9, 2026Updated 3 months ago
- Singer Tap for PostgreSQL☆26Oct 26, 2026Updated last week
- Tools for working with types where a subset of values has a total order, like e.g. floats without NaN☆13Nov 7, 2025Updated 11 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Common GitHub actions and workflows for maintaining dbt☆16Aug 27, 2026Updated 2 months ago
- Tableau extension to enable write-back☆13May 4, 2026Updated 5 months ago
- Streaming audio reactivity in the browser using WebRTC + Web Audio API☆12Nov 17, 2014Updated 11 years ago
- Simple repo to demonstrate how to submit a spark job to EMR from Airflow☆34Oct 18, 2020Updated 6 years ago
- A cheatsheet for working with Supabase and Postgres☆13Mar 29, 2022Updated 4 years ago
- streaming parser for the ZIM aka OpenZIM file format http://www.openzim.org/wiki/ZIM_file_format☆14May 10, 2017Updated 9 years ago
- Analytics engineering with dbt - projects and developer environment☆25Sep 27, 2024Updated 2 years ago