DavidTorpey / pydags
Simple, lightweight, extensible DAG framework for Python with a Kubeflow-like API
☆74Updated 11 months ago
Alternatives and similar repositories for pydags:
Users that are interested in pydags are comparing it to the libraries listed below
- Swiple enables you to easily observe, understand, validate and improve the quality of your data☆83Updated this week
- A robust DAG implementation for parallel execution☆67Updated 11 months ago
- asyncio bridge to the duckdb library☆35Updated last year
- Query CSV, JSON and Parquet files with SQL☆107Updated 7 months ago
- Lightning fast OLAP-style point queries on Pandas DataFrames.☆97Updated 2 months ago
- Lossless in-memory compression of pandas DataFrames and Series powered by the visions type system. Up to 10x less RAM needed for the same…☆28Updated 2 years ago
- dagster scikit-learn pipeline example.☆44Updated last year
- a lightweight, comprehensive solution for managing delta tables built on polars and deltalake☆116Updated 3 weeks ago
- Example Polylith setup for Python☆50Updated 3 weeks ago
- Shared-memory Python object namespace with Apache Plasma. Built because of Plotly Dash, useful anywhere.☆84Updated 2 weeks ago
- Tree Implementation and Methods for Python, integrated with list, dictionary, pandas and polars DataFrame.☆177Updated this week
- A quicker pickle☆108Updated 2 years ago
- Stream Processing Made Easy☆38Updated 2 years ago
- O!My Models (omymodels) is a library to generate Pydantic, Dataclasses, GinoORM Models, SqlAlchemy ORM, SqlAlchemy Core Table, Models fr…☆180Updated 4 months ago
- Prefect integrations for working with Docker☆43Updated 9 months ago
- Turn Pydantic defined Data Models into CLI Tools☆147Updated 4 months ago
- Python bindings for sqlparser-rs☆174Updated 3 months ago
- A high performance caching library for Python written in Rust☆240Updated this week
- 🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.☆99Updated this week
- A repository of runnable examples using ibis☆42Updated 6 months ago
- A general-purpose library designed to guide developers in expressing their code as a flow.☆99Updated this week
- Avoid the CSS/JS/HTML soup - develop web apps entirely in Python☆86Updated 5 months ago
- Simple Workflow Framework - Hamilton + APScheduler = FlowerPower☆14Updated last week
- A toolbox 🧰 for Jupyter notebooks 📙: testing, experiment tracking, debugging, profiling, and more!☆67Updated 4 months ago
- Function dependencies resolution and execution☆71Updated 4 years ago
- YAML support for Pydantic models☆153Updated this week
- SQLAlchemy driver for DuckDB☆382Updated this week
- pandas data creation by data classes☆49Updated 3 weeks ago
- Coming soon☆59Updated last year
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆113Updated 10 months ago