lancedb / lanceLinks
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
☆4,866Updated this week
Alternatives and similar repositories for lance
Users that are interested in lance are comparing it to the libraries listed below
Sorting:
- Distributed query engine providing simple and reliable data processing for any modality and scale☆3,006Updated this week
- Distributed stream processing engine in Rust☆4,388Updated this week
- Developer-friendly, embedded retrieval engine for multimodal AI. Search More; Manage Less.☆6,698Updated last week
- Apache OpenDAL: One Layer, All Storage.☆4,199Updated this week
- Apache DataFusion SQL Query Engine☆7,375Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,780Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆2,834Updated last week
- Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.☆6,026Updated this week
- 𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://data…☆8,502Updated this week
- Making data lake work for time series☆1,175Updated 10 months ago
- Official Rust implementation of Apache Arrow☆2,991Updated this week
- GlareDB: A light and fast SQL database for analytics☆906Updated this week
- Stream processing and management platform.☆7,903Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆3,784Updated this week
- A transactional, relational-graph-vector database that uses Datalog for query. The hippocampus for AI!☆3,650Updated 6 months ago
- Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.☆2,070Updated 4 months ago
- Fast Open-Source Search & Clustering engine × for Vectors & Arbitrary Objects × in C++, C, Python, JavaScript, Rust, Java, Objective-C, S…☆2,806Updated 2 weeks ago
- An extensible, state of the art columnar file format. Formerly at @spiraldb, now a Linux Foundation project.☆1,306Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,337Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,088Updated 2 months ago
- chDB is an in-process OLAP SQL Engine 🚀 powered by ClickHouse☆2,396Updated last week
- Python Stream Processing☆1,766Updated 2 months ago
- Apache Iceberg☆990Updated this week
- A modular implementation of timely dataflow in Rust☆3,468Updated this week
- High-performance runtime for data analytics applications☆3,004Updated 3 years ago
- Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.☆1,483Updated this week
- The Feldera Incremental Computation Engine☆1,454Updated this week
- Postgres with GPUs for ML/AI apps.☆6,340Updated 2 months ago
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,339Updated last week
- An implementation of differential dataflow using timely dataflow on Rust.☆2,751Updated this week