dagster-io / dagsterLinks
An orchestration platform for the development, production, and observation of data assets.
☆13,664Updated this week
Alternatives and similar repositories for dagster
Users that are interested in dagster are comparing it to the libraries listed below
Sorting:
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆19,875Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆11,164Updated this week
- Always know what to expect from your data.☆10,606Updated this week
- The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…☆18,986Updated this week
- the portable Python dataframe library☆5,958Updated this week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆3,951Updated this week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆2,151Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,621Updated this week
- 🧙 Build, run, and manage data pipelines for integrating and transforming data.☆8,432Updated this week
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,499Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆41,262Updated this week
- DuckDB is an analytical in-process SQL database management system☆31,241Updated last week
- Build, Manage and Deploy AI/ML Systems☆9,300Updated this week
- Python SQL Parser and Transpiler☆8,066Updated this week
- Compare tables within or across databases☆2,983Updated last year
- A modular SQL linter and auto-formatter with support for multiple dialects and templated code.☆9,050Updated last week
- A light-weight, flexible, and expressive statistical data testing library☆3,927Updated last week
- Business intelligence as code: build fast, interactive data visualizations in SQL and markdown☆5,418Updated last week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,144Updated last week
- A native Rust library for Delta Lake, with bindings into Python☆2,877Updated last week
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆6,380Updated this week
- Distributed query engine providing simple and reliable data processing for any modality and scale☆3,200Updated this week
- lakeFS - Data version control for your data lake | Git for data☆4,794Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,372Updated last week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,183Updated this week
- Apache DataFusion SQL Query Engine☆7,554Updated this week
- Parallel computing with task scheduling☆13,370Updated this week
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,466Updated this week
- Modin: Scale your Pandas workflows by changing a single line of code☆10,243Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,101Updated 4 months ago