PrefectHQ / prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
☆17,507Updated this week
Related projects ⓘ
Alternatives and complementary repositories for prefect
- An orchestration platform for the development, production, and observation of data assets.☆11,711Updated this week
- DuckDB is an analytical in-process SQL database management system☆24,380Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆9,976Updated this week
- Parallel computing with task scheduling☆12,604Updated this week
- Build data pipelines, the easy way 🛠️☆4,080Updated last year
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆37,168Updated this week
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆17,883Updated last week
- Streamlit — A faster way to build and share data apps.☆35,766Updated this week
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,299Updated last month
- Always know what to expect from your data.☆9,997Updated this week
- Open Source Platform for developing, scaling and deploying serious ML, AI, and data science systems☆8,256Updated this week
- Data Apps & Dashboards for Python. No JavaScript Required.☆21,506Updated this week
- Dolt – Git for Data☆17,974Updated this week
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆5,787Updated this week
- Voilà turns Jupyter notebooks into standalone web applications☆5,465Updated 2 weeks ago
- A high-performance observability data pipeline.☆18,143Updated this week
- Distributed Task Queue (development branch)☆24,899Updated this week
- The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!☆7,161Updated this week
- Apache Superset is a Data Visualization and Data Exploration Platform☆62,868Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,440Updated last week
- the portable Python dataframe library☆5,318Updated this week
- Querybook is a Big Data Querying UI, combining collocated table metadata and a simple notebook interface.☆1,956Updated this week
- Declarative statistical visualization library for Python☆9,384Updated this week
- A modern Python package and dependency manager supporting the latest PEP standards☆7,951Updated this week
- Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.☆26,433Updated 2 weeks ago
- An extremely fast Python linter and code formatter, written in Rust.☆32,890Updated this week
- Modin: Scale your Pandas workflows by changing a single line of code☆9,898Updated last month
- Open source platform for the machine learning lifecycle☆18,812Updated this week
- The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…☆16,219Updated this week
- Dataframes powered by a multithreaded, vectorized query engine, written in Rust☆30,435Updated this week