lance-format / lanceLinks
Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
☆5,795Updated this week
Alternatives and similar repositories for lance
Users that are interested in lance are comparing it to the libraries listed below
Sorting:
- High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale☆4,915Updated this week
- Apache DataFusion SQL Query Engine☆8,130Updated this week
- Distributed stream processing engine in Rust☆4,686Updated last week
- Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.☆8,161Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,911Updated last week
- An extensible, state of the art columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Li…☆2,358Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆3,051Updated this week
- Apache OpenDAL: One Layer, All Storage.☆4,637Updated this week
- Official Rust implementation of Apache Arrow☆3,261Updated this week
- Streaming data platform. Real-time stream processing, low-latency serving, and Iceberg table management.☆8,580Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,496Updated last week
- 𝗔𝗜-𝗡𝗮𝘁𝗶𝘃𝗲 𝗗𝗮𝘁𝗮 𝗪𝗮𝗿𝗲𝗵𝗼𝘂𝘀𝗲. Blazing analytics, fast search, geo insights, vector AI. Built for multimodal analytics, O…☆9,004Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆3,972Updated this week
- Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.☆2,123Updated 9 months ago
- Making data lake work for time series☆1,185Updated last year
- Apache Iceberg☆1,152Updated this week
- Python Stream Processing☆1,895Updated 8 months ago
- Embedded property graph database built for speed. Vector search and full-text search built in. Implements Cypher.☆3,533Updated 2 months ago
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,656Updated this week
- GlareDB: A light and fast SQL database for analytics☆983Updated 3 weeks ago
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,438Updated this week
- The live data layer for apps and AI agents Create up-to-the-second views into your business, just using SQL☆6,184Updated this week
- LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.☆1,087Updated this week
- A cloud native embedded storage engine built on object storage.☆2,504Updated last week
- Apache DataFusion Comet Spark Accelerator☆1,077Updated this week
- ⚡ Fastest SQL ETL pipeline in a single C++ binary, built for stream processing, observability, analytics and AI/ML☆2,094Updated last week
- DuckDB-powered Postgres for high performance apps & analytics.☆2,733Updated last week
- DuckLake is an integrated data lake and catalog format☆2,297Updated this week
- Open-source, cloud-native, unified observability database for metrics, logs and traces, supporting SQL/PromQL/Streaming.☆5,764Updated this week
- Apache HoraeDB (incubating) is a high-performance, distributed, cloud native time-series database.☆2,808Updated last month