PrefectHQ / prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
☆18,036Updated this week
Alternatives and similar repositories for prefect:
Users that are interested in prefect are comparing it to the libraries listed below
- An orchestration platform for the development, production, and observation of data assets.☆12,300Updated this week
- Always know what to expect from your data.☆10,117Updated this week
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,024Updated this week
- Build data pipelines, the easy way 🛠️☆4,099Updated last year
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆38,298Updated this week
- Open Source AI/ML Platform☆8,446Updated this week
- Parallel computing with task scheduling☆12,851Updated this week
- 🦉 Data Versioning and ML Experiments☆14,088Updated this week
- the portable Python dataframe library☆5,451Updated this week
- Declarative visualization library for Python☆9,518Updated this week
- Typer, build great CLIs. Easy to code. Based on Python type hints.☆16,207Updated this week
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,112Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆10,231Updated this week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,538Updated 3 months ago
- Dataframes powered by a multithreaded, vectorized query engine, written in Rust☆31,399Updated this week
- 📚 Parameterize, execute, and analyze notebooks☆6,047Updated last week
- The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…☆16,911Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,474Updated last week
- Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.☆27,335Updated 2 weeks ago
- A light-weight, flexible, and expressive statistical data testing library☆3,546Updated this week
- Python packaging and dependency management made easy☆32,328Updated this week
- Modin: Scale your Pandas workflows by changing a single line of code☆9,975Updated last week
- Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.☆26,754Updated this week
- The simplest, fastest way to get business intelligence and analytics to everyone in your company☆39,522Updated this week
- Diagram as Code for prototyping cloud system architectures☆40,107Updated this week
- Apache Superset is a Data Visualization and Data Exploration Platform☆63,827Updated this week
- Panel: The powerful data exploration & web app framework for Python☆4,952Updated this week
- Dolt – Git for Data☆18,154Updated this week
- DuckDB is an analytical in-process SQL database management system☆25,834Updated this week
- Data-Centric Pipelines and Data Versioning☆6,197Updated this week