PrefectHQ / prefectLinks
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
☆20,668Updated this week
Alternatives and similar repositories for prefect
Users that are interested in prefect are comparing it to the libraries listed below
Sorting:
- An orchestration platform for the development, production, and observation of data assets.☆14,267Updated this week
- Build, Manage and Deploy AI/ML Systems☆9,583Updated this week
- The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…☆19,901Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆11,730Updated last week
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,590Updated last week
- Always know what to expect from your data.☆10,862Updated last week
- Build data pipelines, the easy way 🛠️☆4,143Updated 2 years ago
- 🧙 Build, run, and manage data pipelines for integrating and transforming data.☆8,501Updated last week
- Parallel computing with task scheduling☆13,552Updated last week
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆6,547Updated last week
- Python packaging and dependency management made easy☆33,984Updated last week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆42,942Updated this week
- A modular SQL linter and auto-formatter with support for multiple dialects and templated code.☆9,275Updated this week
- the portable Python dataframe library☆6,178Updated this week
- Extremely fast Query Engine for DataFrames, written in Rust☆35,793Updated last week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,605Updated 5 months ago
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,540Updated 5 months ago
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆4,325Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆4,068Updated 2 weeks ago
- DuckDB is an analytical in-process SQL database management system☆33,726Updated this week
- Modin: Scale your Pandas workflows by changing a single line of code☆10,311Updated 3 weeks ago
- Declarative visualization library for Python☆10,083Updated this week
- Diagram as Code for prototyping cloud system architectures☆41,655Updated this week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆2,241Updated this week
- Querybook is a Big Data Querying UI, combining collocated table metadata and a simple notebook interface.☆2,193Updated last week
- Python SQL Parser and Transpiler☆8,479Updated this week
- Voil à turns Jupyter notebooks into standalone web applications☆5,839Updated 3 weeks ago
- Workflow Engine for Kubernetes☆16,133Updated this week
- Data validation using Python type hints☆25,587Updated this week
- Streamlit — A faster way to build and share data apps.☆41,932Updated this week