PrefectHQ / prefectLinks
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
☆21,253Updated this week
Alternatives and similar repositories for prefect
Users that are interested in prefect are comparing it to the libraries listed below
Sorting:
- An orchestration platform for the development, production, and observation of data assets.☆14,676Updated this week
- Build, Manage and Deploy AI/ML Systems☆9,696Updated 2 weeks ago
- Always know what to expect from your data.☆11,039Updated 2 weeks ago
- Parallel computing with task scheduling☆13,679Updated this week
- Typer, build great CLIs. Easy to code. Based on Python type hints.☆18,574Updated last week
- Build data pipelines, the easy way 🛠️☆4,147Updated 2 years ago
- the portable Python dataframe library☆6,318Updated this week
- 🧙 Build, run, and manage data pipelines for integrating and transforming data.☆8,598Updated 2 weeks ago
- FastAPI framework, high performance, easy to learn, fast to code, ready for production☆93,651Updated this week
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,691Updated last week
- Python Stream Processing☆6,831Updated last year
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆43,722Updated this week
- Data validation using Python type hints☆26,379Updated this week
- Modin: Scale your Pandas workflows by changing a single line of code☆10,343Updated 3 months ago
- A modular SQL linter and auto-formatter with support for multiple dialects and templated code.☆9,402Updated this week
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,617Updated last week
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,464Updated 2 months ago
- The Open Source Feature Store for AI/ML☆6,576Updated this week
- Streamlit — A faster way to build and share data apps.☆42,940Updated this week
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆6,654Updated last week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆12,039Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆4,159Updated this week
- SQL databases in Python, designed for simplicity, compatibility, and robustness.☆17,415Updated last week
- ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.☆5,128Updated this week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,610Updated 7 months ago
- 📚 Parameterize, execute, and analyze notebooks☆6,345Updated last month
- Python SQL Parser and Transpiler☆8,756Updated this week
- The little ASGI framework that shines. 🌟☆11,816Updated this week
- Retrying library for Python☆8,222Updated this week
- A modern Python package and dependency manager supporting the latest PEP standards☆8,529Updated this week