PrefectHQ / prefectLinks
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
☆20,911Updated this week
Alternatives and similar repositories for prefect
Users that are interested in prefect are comparing it to the libraries listed below
Sorting:
- An orchestration platform for the development, production, and observation of data assets.☆14,455Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆43,294Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆11,861Updated last week
- Build, Manage and Deploy AI/ML Systems☆9,640Updated this week
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,640Updated last week
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,564Updated 6 months ago
- 🧙 Build, run, and manage data pipelines for integrating and transforming data.☆8,559Updated last week
- Data validation using Python type hints☆25,933Updated this week
- Always know what to expect from your data.☆10,929Updated last week
- Python logging made (stupidly) simple☆23,133Updated 2 weeks ago
- A next generation HTTP client for Python. 🦋☆14,755Updated last month
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆6,597Updated last week
- A modular SQL linter and auto-formatter with support for multiple dialects and templated code.☆9,319Updated last week
- Memray is a memory profiler for Python☆14,600Updated last week
- Data Apps & Dashboards for Python. No JavaScript Required.☆24,272Updated this week
- Python SQL Parser and Transpiler☆8,603Updated this week
- Python packaging and dependency management made easy☆34,061Updated last week
- The Open Source Feature Store for AI/ML☆6,491Updated this week
- Build data pipelines, the easy way 🛠️☆4,144Updated 2 years ago
- Performant type-checking for python.☆7,117Updated this week
- Retrying library for Python☆8,084Updated 3 weeks ago
- the portable Python dataframe library☆6,226Updated this week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆4,573Updated this week
- 🦉 Data Versioning and ML Experiments☆15,128Updated this week
- Parallel computing with task scheduling☆13,603Updated last week
- Distributed Task Queue (development branch)☆27,613Updated this week
- The little ASGI framework that shines. 🌟☆11,683Updated 3 weeks ago
- An ASGI web server, for Python. 🦄☆10,098Updated 3 weeks ago
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆2,270Updated this week
- The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…☆20,099Updated this week