lancedb / lance
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
☆4,138Updated this week
Alternatives and similar repositories for lance:
Users that are interested in lance are comparing it to the libraries listed below
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,499Updated this week
- Apache DataFusion SQL Query Engine☆6,682Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,631Updated this week
- Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.☆1,890Updated last week
- Making data lake work for time series☆1,150Updated 5 months ago
- Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!☆5,342Updated this week
- Distributed stream processing engine in Rust☆3,927Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆2,512Updated this week
- Official Rust implementation of Apache Arrow☆2,722Updated this week
- Fast Open-Source Search & Clustering engine × for Vectors & 🔜 Strings × in C++, C, Python, JavaScript, Rust, Java, Objective-C, Swift, C…☆2,423Updated this week
- Postgres with GPUs for ML/AI apps.☆6,126Updated this week
- DuckDB-powered Postgres for high performance apps & analytics.☆1,923Updated this week
- Apache OpenDAL: One Layer, All Storage.☆3,695Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,242Updated this week
- The Cloud Operational Data Store: use SQL to transform, deliver, and act on fast-changing data.☆5,865Updated this week
- GlareDB: An analytics DBMS for distributed data☆758Updated this week
- the portable Python dataframe library☆5,466Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,038Updated 4 months ago
- Transmute-free Rust library to work with the Arrow format☆1,062Updated 11 months ago
- An extensible, state-of-the-art columnar file format☆1,083Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,080Updated this week
- Embeddable property graph database management system built for query speed and scalability. Implements Cypher.☆1,580Updated this week
- Postgres for Search and Analytics☆6,594Updated this week
- Python Stream Processing☆1,617Updated last week
- Streaming database. Unified experience for real-time data ingestion, stream processing, and low-latency serving. Best-in-class performanc…☆7,279Updated this week
- Malloy is an experimental language for describing data relationships and transformations.☆2,039Updated this week
- 🦆 A curated list of awesome DuckDB resources☆1,503Updated this week
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,827Updated this week
- A cloud native embedded storage engine built on object storage.☆1,767Updated this week
- A transactional, relational-graph-vector database that uses Datalog for query. The hippocampus for AI!☆3,504Updated last month