dagster-io / dagsterLinks
An orchestration platform for the development, production, and observation of data assets.
☆14,644Updated this week
Alternatives and similar repositories for dagster
Users that are interested in dagster are comparing it to the libraries listed below
Sorting:
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆21,158Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆12,020Updated this week
- Always know what to expect from your data.☆11,019Updated this week
- The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…☆20,321Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,711Updated last week
- the portable Python dataframe library☆6,296Updated this week
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,686Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆43,611Updated this week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆4,723Updated this week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆2,296Updated this week
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆6,645Updated this week
- Self-serve BI to 10x your data team ⚡️☆5,413Updated this week
- 🧙 Build, run, and manage data pipelines for integrating and transforming data.☆8,593Updated last week
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,820Updated last week
- lakeFS - Data version control for your data lake | Git for data☆5,052Updated this week
- A modular SQL linter and auto-formatter with support for multiple dialects and templated code.☆9,386Updated this week
- Business intelligence as code: build fast, interactive data visualizations in SQL and markdown☆5,765Updated last week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,484Updated last week
- The Open Source Feature Store for AI/ML☆6,561Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆4,135Updated this week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,264Updated last week
- A curated list of awesome ETL frameworks, libraries, and software.☆3,502Updated last year
- A native Rust library for Delta Lake, with bindings into Python☆3,077Updated last week
- An Open Standard for lineage metadata collection☆2,235Updated last week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,560Updated last month
- 🦉 Data Versioning and ML Experiments☆15,221Updated this week
- Python SQL Parser and Transpiler☆8,745Updated this week
- re_data - fix data issues before your users & CEO would discover them 😊☆1,570Updated last year
- Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data ve…☆5,856Updated this week
- Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.☆2,427Updated this week