PrefectHQ / prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
☆18,661Updated this week
Alternatives and similar repositories for prefect:
Users that are interested in prefect are comparing it to the libraries listed below
- An orchestration platform for the development, production, and observation of data assets.☆12,772Updated this week
- Streamlit — A faster way to build and share data apps.☆38,319Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆39,217Updated this week
- Build data pipelines, the easy way 🛠️☆4,113Updated last year
- Build, Deploy and Manage AI/ML Systems☆8,644Updated this week
- Always know what to expect from your data.☆10,273Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆10,554Updated this week
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆6,109Updated this week
- The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…☆17,591Updated this week
- Panel: The powerful data exploration & web app framework for Python☆5,114Updated this week
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,228Updated this week
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,175Updated last month
- Parallel computing with task scheduling☆13,045Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆3,688Updated 2 weeks ago
- Typer, build great CLIs. Easy to code. Based on Python type hints.☆16,662Updated this week
- Data validation using Python type hints☆22,911Updated this week
- Modin: Scale your Pandas workflows by changing a single line of code☆10,064Updated this week
- ZenML 🙏: The bridge between ML and Ops. https://zenml.io.☆4,472Updated this week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,557Updated 6 months ago
- Open source platform for the machine learning lifecycle☆19,824Updated this week
- Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.☆27,486Updated 3 weeks ago
- Dataframes powered by a multithreaded, vectorized query engine, written in Rust☆32,499Updated this week
- Retrying library for Python☆7,218Updated 2 weeks ago
- The Open Source Feature Store for AI/ML☆5,874Updated this week
- Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with struc…☆12,809Updated this week
- Create delightful software with Jupyter Notebooks☆5,040Updated this week
- An extremely fast Python linter and code formatter, written in Rust.☆36,903Updated this week
- Pyodide is a Python distribution for the browser and Node.js based on WebAssembly☆12,877Updated this week
- Python SQL Parser and Transpiler☆7,359Updated this week
- the portable Python dataframe library☆5,608Updated this week