Alternatives and similar repositories for prefect

Users that are interested in prefect are comparing it to the libraries listed below

• dagster-io / dagster
  An orchestration platform for the development, production, and observation of data assets.
  ☆13,990Updated this week
• apache / airflow
  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
  ☆42,378Updated this week
• great-expectations / great_expectations
  Always know what to expect from your data.
  ☆10,722Updated this week
• dbt-labs / dbt-core
  dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…
  ☆11,371Updated this week
• Netflix / metaflow
  Build, Manage and Deploy AI/ML Systems
  ☆9,470Updated this week
• dask / dask
  Parallel computing with task scheduling
  ☆13,481Updated last week
• spotify / luigi
  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…
  ☆18,477Updated 4 months ago
• flyteorg / flyte
  Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
  ☆6,488Updated this week
• airbytehq / airbyte
  The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…
  ☆19,468Updated last week
• mage-ai / mage-ai
  🧙 Build, run, and manage data pipelines for integrating and transforming data.
  ☆8,464Updated this week
• ibis-project / ibis
  the portable Python dataframe library
  ☆6,101Updated this week
• kedro-org / kedro
  Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…
  ☆10,526Updated last week
• pydantic / pydantic
  Data validation using Python type hints
  ☆25,153Updated last week
• modin-project / modin
  Modin: Scale your Pandas workflows by changing a single line of code
  ☆10,273Updated this week
• unionai-oss / pandera
  A light-weight, flexible, and expressive statistical data testing library
  ☆4,016Updated 2 weeks ago
• pola-rs / polars
  Extremely fast Query Engine for DataFrames, written in Rust
  ☆35,310Updated this week
• amundsen-io / amundsen
  Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…
  ☆4,648Updated this week
• pditommaso / awesome-pipeline
  A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin
  ☆6,441Updated 3 weeks ago
• fastapi / typer
  Typer, build great CLIs. Easy to code. Based on Python type hints.
  ☆17,869Updated last week
• bentoml / BentoML
  The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
  ☆8,073Updated this week
• streamlit / streamlit
  Streamlit — A faster way to build and share data apps.
  ☆41,384Updated this week
• orchest / orchest
  Build data pipelines, the easy way 🛠️
  ☆4,142Updated 2 years ago
• jghoman / awesome-apache-airflow
  Curated list of resources about Apache Airflow
  ☆3,832Updated last year
• duckdb / duckdb
  DuckDB is an analytical in-process SQL database management system
  ☆32,807Updated this week
• feast-dev / feast
  The Open Source Feature Store for AI/ML
  ☆6,330Updated this week
• robinhood / faust
  Python Stream Processing
  ☆6,824Updated last year
• python-poetry / poetry
  Python packaging and dependency management made easy
  ☆33,908Updated this week
• vaexio / vaex
  Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…
  ☆8,428Updated 2 weeks ago
• facebook / pyre-check
  Performant type-checking for python.
  ☆7,090Updated this week
• nteract / papermill
  📚 Parameterize, execute, and analyze notebooks
  ☆6,261Updated 2 months ago