aai-institute / lakefs-spec
An fsspec implementation for the lakeFS project
☆48Updated 3 weeks ago
Alternatives and similar repositories for lakefs-spec:
Users that are interested in lakefs-spec are comparing it to the libraries listed below
- IbisML is a library for building scalable ML pipelines using Ibis.☆108Updated 3 months ago
- Ray integration for Dagster☆37Updated last week
- Python bindings and arrow integration for the rust object_store crate.☆64Updated 8 months ago
- A data modelling layer built on top of polars and pydantic☆194Updated last year
- Polars plugin for stable hashing functionality☆70Updated this week
- Jupyter + Marimo = ❤️☆48Updated 9 months ago
- A playground for running duckdb as a stateless query engine over a data lake☆197Updated last year
- This repo contains information about DuckDB extensions found on GitHub. Refreshed daily☆96Updated this week
- Coming soon☆61Updated last year
- Prepare requirements and deploy Flyte using Helm☆66Updated last week
- Prefect integrations for working with Docker☆43Updated 11 months ago
- A high-performance data streaming system using DuckDB and Apache Arrow Flight.☆76Updated 2 months ago
- Read Apache Arrow batches from ODBC data sources in Python☆65Updated this week
- A library to convert a pydantic model to a pyarrow schema☆27Updated 2 months ago
- DuckDB API Server with Arrow Flight SQL Airport support and concurrent writes/reads (quackpipe)☆70Updated last month
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- 🛡️ Managed isolated environments for Python☆90Updated last week
- Prefect API Authentication/Authorization Proxy for on-premises deployments☆38Updated 4 months ago
- pathlib api extended to use fsspec backends☆299Updated this week
- The Airport extension for DuckDB, enables the use of Arrow Flight with DuckDB☆186Updated last week
- A kedro plugin that streamlines the integration between Kedro projects and third-party applications, making it easier for you to develop…☆38Updated 2 months ago
- Write your dbt models using Ibis☆64Updated last month
- Helm charts for deploying Prefect Services☆119Updated this week
- Minimal plugin loading package for polars with optional type stub generation☆16Updated last month
- Arrow, pydantic style☆82Updated 2 years ago
- Kedro extension for VSCode including LSP and other features☆20Updated 2 weeks ago
- A set of IaC artifacts to automatically configure the infrastructure resources needed by a Flyte deployment☆29Updated last month
- A Delta Lake reader for Dask☆49Updated 6 months ago
- ☆89Updated 3 months ago
- deferred computational framework for multi-engine pipelines☆234Updated this week