dagster-io / dagsterLinks
An orchestration platform for the development, production, and observation of data assets.
☆13,819Updated this week
Alternatives and similar repositories for dagster
Users that are interested in dagster are comparing it to the libraries listed below
Sorting:
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆11,252Updated last week
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆20,138Updated this week
- the portable Python dataframe library☆6,039Updated this week
- Build, Manage and Deploy AI/ML Systems☆9,418Updated this week
- Always know what to expect from your data.☆10,642Updated last week
- The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…☆19,203Updated last week
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆6,419Updated last week
- Parallel computing with task scheduling☆13,416Updated last week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,629Updated 3 weeks ago
- A light-weight, flexible, and expressive statistical data testing library☆3,969Updated last week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆4,022Updated this week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆2,173Updated last week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,600Updated 2 months ago
- The Open Source Feature Store for AI/ML☆6,273Updated last week
- A modular SQL linter and auto-formatter with support for multiple dialects and templated code.☆9,134Updated 2 weeks ago
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,543Updated this week
- Querybook is a Big Data Querying UI, combining collocated table metadata and a simple notebook interface.☆2,157Updated 2 months ago
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,101Updated 4 months ago
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,489Updated last week
- The open source developer platform to build AI/LLM applications and models with confidence. Enhance your AI applications with end-to-end …☆21,626Updated last week
- lakeFS - Data version control for your data lake | Git for data☆4,820Updated last week
- Business intelligence as code: build fast, interactive data visualizations in SQL and markdown☆5,473Updated last week
- A native Rust library for Delta Lake, with bindings into Python☆2,904Updated last week
- 📚 Parameterize, execute, and analyze notebooks☆6,245Updated last month
- 🧙 Build, run, and manage data pipelines for integrating and transforming data.☆8,447Updated last week
- Distributed query engine providing simple and reliable data processing for any modality and scale☆3,280Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,215Updated last week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆41,662Updated this week
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆5,227Updated last week
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,438Updated 3 months ago