dagster-io / dagster
An orchestration platform for the development, production, and observation of data assets.
☆12,954Updated this week
Alternatives and similar repositories for dagster:
Users that are interested in dagster are comparing it to the libraries listed below
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆19,009Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆10,685Updated this week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆3,472Updated this week
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,242Updated this week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆2,032Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,556Updated 2 weeks ago
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,063Updated this week
- Always know what to expect from your data.☆10,324Updated last week
- Compare tables within or across databases☆2,965Updated 11 months ago
- 🧙 Build, run, and manage data pipelines for integrating and transforming data.☆8,245Updated last week
- The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…☆17,903Updated this week
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆6,179Updated last week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,072Updated 3 weeks ago
- A native Rust library for Delta Lake, with bindings into Python☆2,689Updated this week
- DuckDB is an analytical in-process SQL database management system☆28,513Updated this week
- Build, Manage and Deploy AI/ML Systems☆8,730Updated this week
- Utility functions for dbt projects.☆1,507Updated 2 weeks ago
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,272Updated this week
- Python SQL Parser and Transpiler☆7,514Updated this week
- A modular SQL linter and auto-formatter with support for multiple dialects and templated code.☆8,788Updated this week
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆4,454Updated this week
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,736Updated this week
- The Open Source Feature Store for AI/ML☆5,955Updated this week
- Build data pipelines, the easy way 🛠️☆4,113Updated last year
- A light-weight, flexible, and expressive statistical data testing library☆3,754Updated this week
- Open source platform for the machine learning lifecycle☆20,220Updated this week
- 📚 Parameterize, execute, and analyze notebooks☆6,130Updated 2 weeks ago
- the portable Python dataframe library☆5,699Updated this week
- Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.☆2,008Updated this week
- The fastest ⚡ ️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,556Updated 7 months ago