dagster-io / dagsterLinks
An orchestration platform for the development, production, and observation of data assets.
☆13,408Updated this week
Alternatives and similar repositories for dagster
Users that are interested in dagster are comparing it to the libraries listed below
Sorting:
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆19,550Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆10,990Updated this week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆3,750Updated this week
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆6,297Updated this week
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,404Updated this week
- the portable Python dataframe library☆5,849Updated this week
- The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…☆18,459Updated this week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆2,108Updated this week
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,389Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,598Updated 2 weeks ago
- Always know what to expect from your data.☆10,480Updated this week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,118Updated last week
- Compare tables within or across databases☆2,972Updated last year
- Build, Manage and Deploy AI/ML Systems☆8,888Updated this week
- Distributed query engine providing simple and reliable data processing for any modality and scale☆2,920Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆3,854Updated last week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,088Updated this week
- Malloy is an experimental language for describing data relationships and transformations.☆2,172Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆15,579Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,087Updated 2 months ago
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,334Updated this week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,586Updated 3 weeks ago
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆40,585Updated this week
- Python SQL Parser and Transpiler☆7,866Updated last week
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,343Updated last month
- MetricFlow allows you to define, build, and maintain metrics in code.☆1,224Updated last week
- Self-serve BI to 10x your data team ⚡️☆4,799Updated this week
- 🦉 Data Versioning and ML Experiments☆14,563Updated this week
- 🧙 Build, run, and manage data pipelines for integrating and transforming data.☆8,377Updated this week
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆4,826Updated this week