dagster-io / dagsterLinks
An orchestration platform for the development, production, and observation of data assets.
☆14,267Updated this week
Alternatives and similar repositories for dagster
Users that are interested in dagster are comparing it to the libraries listed below
Sorting:
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆20,620Updated last week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆11,730Updated last week
- the portable Python dataframe library☆6,172Updated last week
- Always know what to expect from your data.☆10,862Updated this week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆4,325Updated this week
- 🧙 Build, run, and manage data pipelines for integrating and transforming data.☆8,501Updated this week
- The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…☆19,852Updated this week
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,590Updated this week
- Python SQL Parser and Transpiler☆8,479Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,672Updated 3 weeks ago
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,686Updated this week
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,540Updated 5 months ago
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆6,547Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆42,942Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆16,082Updated last week
- Build data pipelines, the easy way 🛠️☆4,143Updated 2 years ago
- Extremely fast Query Engine for DataFrames, written in Rust☆35,793Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆4,068Updated 2 weeks ago
- Build, Manage and Deploy AI/ML Systems☆9,583Updated this week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆2,228Updated this week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,204Updated this week
- Data validation using Python type hints☆25,511Updated last week
- Data-Centric Pipelines and Data Versioning☆6,262Updated 8 months ago
- Distributed query engine providing simple and reliable data processing for any modality and scale☆4,642Updated this week
- Curated list of resources about Apache Airflow☆3,850Updated last year
- DuckDB is an analytical in-process SQL database management system☆33,726Updated this week
- Parallel computing with task scheduling☆13,552Updated this week
- lakeFS - Data version control for your data lake | Git for data☆4,931Updated last week
- A modular SQL linter and auto-formatter with support for multiple dialects and templated code.☆9,251Updated last week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,605Updated 4 months ago