lancedb / lance
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
☆4,507Updated this week
Alternatives and similar repositories for lance:
Users that are interested in lance are comparing it to the libraries listed below
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,743Updated this week
- Apache DataFusion SQL Query Engine☆7,073Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,724Updated last week
- Developer-friendly, embedded retrieval engine for multimodal AI. Search More; Manage Less.☆6,234Updated this week
- Distributed stream processing engine in Rust☆4,275Updated last week
- A native Rust library for Delta Lake, with bindings into Python☆2,700Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,219Updated last week
- Official Rust implementation of Apache Arrow☆2,897Updated this week
- Making data lake work for time series☆1,164Updated 8 months ago
- Apache OpenDAL: One Layer, All Storage.☆4,040Updated this week
- Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.☆5,959Updated this week
- A transactional, relational-graph-vector database that uses Datalog for query. The hippocampus for AI!☆3,602Updated 4 months ago
- A composable and fully extensible C++ execution engine library for data management systems.☆3,707Updated this week
- Stream processing and management platform.☆7,669Updated this week
- Python Stream Processing☆1,711Updated 3 weeks ago
- Postgres with GPUs for ML/AI apps.☆6,247Updated last week
- 𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://data…☆8,356Updated this week
- Embedded property graph database built for speed. Vector search and full-text search built in. Implements Cypher.☆2,210Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,074Updated 3 weeks ago
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,289Updated this week
- Apache Iceberg☆894Updated this week
- the portable Python dataframe library☆5,705Updated this week
- Fast Open-Source Search & Clustering engine × for Vectors & 🔜 Strings × in C++, C, Python, JavaScript, Rust, Java, Objective-C, Swift, C…☆2,674Updated last week
- Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.☆2,014Updated last month
- Tantivy is a full-text search engine library inspired by Apache Lucene and written in Rust☆13,025Updated last week
- An extensible, state of the art columnar file format☆1,207Updated this week
- WebAssembly version of DuckDB☆1,531Updated last week
- High-performance runtime for data analytics applications☆2,997Updated 2 years ago
- Transmute-free Rust library to work with the Arrow format☆1,061Updated last year
- Extensible SQL Lexer and Parser for Rust☆3,028Updated last week