Alternatives and similar repositories for prefect

Users that are interested in prefect are comparing it to the libraries listed below

• dagster-io / dagster
  An orchestration platform for the development, production, and observation of data assets.
  ☆14,126Updated last week
• dbt-labs / dbt-core
  dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…
  ☆11,633Updated this week
• Netflix / metaflow
  Build, Manage and Deploy AI/ML Systems
  ☆9,558Updated this week
• airbytehq / airbyte
  The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…
  ☆19,729Updated this week
• ibis-project / ibis
  the portable Python dataframe library
  ☆6,136Updated this week
• great-expectations / great_expectations
  Always know what to expect from your data.
  ☆10,816Updated this week
• apache / airflow
  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
  ☆42,676Updated this week
• pola-rs / polars
  Extremely fast Query Engine for DataFrames, written in Rust
  ☆35,586Updated this week
• dask / dask
  Parallel computing with task scheduling
  ☆13,518Updated this week
• streamlit / streamlit
  Streamlit — A faster way to build and share data apps.
  ☆41,651Updated this week
• kedro-org / kedro
  Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…
  ☆10,570Updated this week
• iterative / dvc
  🦉 Data Versioning and ML Experiments
  ☆14,948Updated this week
• mage-ai / mage-ai
  🧙 Build, run, and manage data pipelines for integrating and transforming data.
  ☆8,487Updated this week
• unionai-oss / pandera
  A light-weight, flexible, and expressive statistical data testing library
  ☆4,038Updated last week
• flyteorg / flyte
  Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
  ☆6,531Updated this week
• pydantic / pydantic
  Data validation using Python type hints
  ☆25,389Updated this week
• duckdb / duckdb
  DuckDB is an analytical in-process SQL database management system
  ☆33,214Updated this week
• sqlfluff / sqlfluff
  A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
  ☆9,216Updated this week
• dlt-hub / dlt
  data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
  ☆4,222Updated last week
• fastapi / typer
  Typer, build great CLIs. Easy to code. Based on Python type hints.
  ☆17,997Updated this week
• apache / arrow
  Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
  ☆16,031Updated this week
• python-poetry / poetry
  Python packaging and dependency management made easy
  ☆33,942Updated this week
• orchest / orchest
  Build data pipelines, the easy way 🛠️
  ☆4,141Updated 2 years ago
• nteract / papermill
  📚 Parameterize, execute, and analyze notebooks
  ☆6,282Updated this week
• vaexio / vaex
  Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…
  ☆8,433Updated last week
• feast-dev / feast
  The Open Source Feature Store for AI/ML
  ☆6,366Updated this week
• google / python-fire
  Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.
  ☆27,911Updated last week
• modin-project / modin
  Modin: Scale your Pandas workflows by changing a single line of code
  ☆10,289Updated last week
• mlflow / mlflow
  The open source developer platform to build AI/LLM applications and models with confidence. Enhance your AI applications with end-to-end …
  ☆22,392Updated this week
• spotify / luigi
  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…
  ☆18,514Updated 4 months ago