PrefectHQ / prefect

Related projects: ⓘ

• dagster-io / dagster
  An orchestration platform for the development, production, and observation of data assets.
  ☆11,155Updated this week
• kedro-org / kedro
  Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…
  ☆9,837Updated this week
• apache / airflow
  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
  ☆36,304Updated this week
• Netflix / metaflow
  Build and manage real-life ML, AI, and data science projects with ease!
  ☆8,046Updated this week
• airbytehq / airbyte
  The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…
  ☆15,484Updated this week
• pola-rs / polars
  Dataframes powered by a multithreaded, vectorized query engine, written in Rust
  ☆29,261Updated this week
• great-expectations / great_expectations
  Always know what to expect from your data.
  ☆9,817Updated this week
• fastapi / typer
  Typer, build great CLIs. Easy to code. Based on Python type hints.
  ☆15,405Updated this week
• dbt-labs / dbt-core
  dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…
  ☆9,626Updated this week
• duckdb / duckdb
  DuckDB is an analytical in-process SQL database management system
  ☆22,674Updated this week
• spotify / luigi
  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…
  ☆17,705Updated last week
• python-poetry / poetry
  Python packaging and dependency management made easy
  ☆31,084Updated this week
• iterative / dvc
  🦉 ML Experiments and Data Management with Git
  ☆13,608Updated this week
• pydantic / pydantic
  Data validation using Python type hints
  ☆20,491Updated this week
• streamlit / streamlit
  Streamlit — A faster way to build and share data apps.
  ☆34,580Updated this week
• bloomberg / memray
  Memray is a memory profiler for Python
  ☆13,127Updated this week
• flyteorg / flyte
  Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
  ☆5,418Updated this week
• mlflow / mlflow
  Open source platform for the machine learning lifecycle
  ☆18,340Updated this week
• robinhood / faust
  Python Stream Processing
  ☆6,722Updated last month
• dask / dask
  Parallel computing with task scheduling
  ☆12,405Updated this week
• ibis-project / ibis
  the portable Python dataframe library
  ☆5,064Updated this week
• sqlfluff / sqlfluff
  A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
  ☆7,642Updated this week
• plotly / dash
  Data Apps & Dashboards for Python. No JavaScript Required.
  ☆21,166Updated last week
• astral-sh / ruff
  An extremely fast Python linter and code formatter, written in Rust.
  ☆31,033Updated this week
• mingrammer / diagrams
  Diagram as Code for prototyping cloud system architectures
  ☆36,849Updated last month
• Delgan / loguru
  Python logging made (stupidly) simple
  ☆19,468Updated this week
• modin-project / modin
  Modin: Scale your Pandas workflows by changing a single line of code
  ☆9,747Updated this week
• orchest / orchest
  Build data pipelines, the easy way 🛠️
  ☆4,055Updated last year
• psf / black
  The uncompromising Python code formatter
  ☆38,591Updated this week
• pyodide / pyodide
  Pyodide is a Python distribution for the browser and Node.js based on WebAssembly
  ☆11,993Updated this week