PrefectHQ / prefectLinks
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
☆19,754Updated this week
Alternatives and similar repositories for prefect
Users that are interested in prefect are comparing it to the libraries listed below
Sorting:
- An orchestration platform for the development, production, and observation of data assets.☆13,567Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆11,078Updated this week
- Build, Manage and Deploy AI/ML Systems☆8,950Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆40,947Updated this week
- The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…☆18,684Updated this week
- the portable Python dataframe library☆5,913Updated this week
- Parallel computing with task scheduling☆13,337Updated this week
- Always know what to expect from your data.☆10,555Updated this week
- DuckDB is an analytical in-process SQL database management system☆30,862Updated this week
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,365Updated last month
- Dataframes powered by a multithreaded, vectorized query engine, written in Rust☆34,392Updated this week
- Typer, build great CLIs. Easy to code. Based on Python type hints.☆17,412Updated last week
- 🧙 Build, run, and manage data pipelines for integrating and transforming data.☆8,415Updated this week
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆6,350Updated this week
- Build data pipelines, the easy way 🛠️☆4,129Updated 2 years ago
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,427Updated this week
- 📊 Cube’s universal semantic layer platform is the next evolution of OLAP technology for AI, BI, spreadsheets, and embedded analytics☆18,674Updated this week
- Python Stream Processing☆6,805Updated 11 months ago
- Data validation using Python type hints☆24,449Updated this week
- An open source multi-tool for exploring and publishing data☆10,171Updated last month
- Streamlit — A faster way to build and share data apps.☆40,317Updated this week
- Voilà turns Jupyter notebooks into standalone web applications☆5,752Updated this week
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,404Updated 9 months ago
- Python packaging and dependency management made easy☆33,416Updated last week
- 📚 Parameterize, execute, and analyze notebooks☆6,215Updated last week
- A modular SQL linter and auto-formatter with support for multiple dialects and templated code.☆9,008Updated this week
- Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.☆27,743Updated last week
- Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cl…☆24,545Updated this week
- 🦉 Data Versioning and ML Experiments☆14,647Updated this week
- Panel: The powerful data exploration & web app framework for Python☆5,301Updated this week