pracdata / awesome-open-source-data-engineering
A curated list of open source tools used in analytics platforms and data engineering ecosystem
☆194Updated 2 months ago
Alternatives and similar repositories for awesome-open-source-data-engineering:
Users that are interested in awesome-open-source-data-engineering are comparing it to the libraries listed below
- A portable Datamart and Business Intelligence suite built with Docker, Dagster, dbt, DuckDB and Superset☆212Updated last week
- Quickstart for any service☆138Updated this week
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆206Updated this week
- ☆107Updated 6 months ago
- In this repository we store all materials for dlt workshops, courses, etc.☆101Updated last month
- Turning PySpark Into a Universal DataFrame API☆354Updated this week
- A curated list of awesome public DBT projects☆106Updated last year
- Data product portal created by Dataminded☆172Updated this week
- ☆101Updated 2 weeks ago
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆63Updated 4 months ago
- an ephemeral project repo for the DU Dagster project☆62Updated this week
- New generation opensource data stack☆65Updated 2 years ago
- Code for dbt tutorial☆149Updated 7 months ago
- Local Environment to Practice Data Engineering☆136Updated 3 weeks ago
- The Open-Source Enterprise Data Platform in a single Portal☆230Updated this week
- The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…☆231Updated 3 months ago
- Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…☆59Updated last year
- Code for "Efficient Data Processing in Spark" Course☆272Updated 3 months ago
- Sample project to demonstrate data engineering best practices☆175Updated 11 months ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆72Updated last year
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆122Updated 6 months ago
- Quick Guides from Dremio on Several topics☆67Updated last week
- Scalefree's dbt package for a Data Vault 2.0 implementation congruent to the original Data Vault 2.0 definition by Dan Linstedt including…☆147Updated this week
- Open Control Plane for Tables in Data Lakehouse☆321Updated last week
- A curated list of awesome DataOps tools☆169Updated 3 months ago
- Data Tools Subjective List☆82Updated last year
- Possibly the fastest DataFrame-agnostic quality check library in town.☆180Updated this week
- System Design, Solution Architecture, Data Systems Practice☆35Updated last month
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆254Updated 6 months ago
- New Generation Opensource Data Stack Demo☆420Updated last year