PrefectHQ / prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
☆18,202Updated this week
Alternatives and similar repositories for prefect:
Users that are interested in prefect are comparing it to the libraries listed below
- An orchestration platform for the development, production, and observation of data assets.☆12,470Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆10,334Updated this week
- Always know what to expect from your data.☆10,178Updated this week
- 🧙 Build, run, and manage data pipelines for integrating and transforming data.☆8,126Updated this week
- Parallel computing with task scheduling☆12,909Updated this week
- Python packaging and dependency management made easy☆32,507Updated this week
- Typer, build great CLIs. Easy to code. Based on Python type hints.☆16,346Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆3,605Updated 2 weeks ago
- the portable Python dataframe library☆5,493Updated this week
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,147Updated this week
- Open Source AI/ML Platform☆8,508Updated this week
- The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…☆17,159Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆38,618Updated this week
- The uncompromising Python code formatter☆39,534Updated this week
- Data validation using Python type hints☆22,314Updated this week
- 📚 Parameterize, execute, and analyze notebooks☆6,072Updated last month
- Build data pipelines, the easy way 🛠️☆4,106Updated last year
- Dataframes powered by a multithreaded, vectorized query engine, written in Rust☆31,755Updated this week
- A modular SQL linter and auto-formatter with support for multiple dialects and templated code.☆8,542Updated this week
- Data Apps & Dashboards for Python. No JavaScript Required.☆21,896Updated this week
- 🦉 Data Versioning and ML Experiments☆14,139Updated this week
- DuckDB is an analytical in-process SQL database management system☆26,269Updated this week
- Panel: The powerful data exploration & web app framework for Python☆5,012Updated this week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,539Updated 4 months ago
- Pyodide is a Python distribution for the browser and Node.js based on WebAssembly☆12,671Updated this week
- Streamlit — A faster way to build and share data apps.☆37,128Updated this week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆3,065Updated this week
- Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.☆27,380Updated last week
- An extremely fast Python linter and code formatter, written in Rust.☆35,510Updated this week
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,261Updated 2 months ago