lance-format / lanceLinks
Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
☆5,925Updated this week
Alternatives and similar repositories for lance
Users that are interested in lance are comparing it to the libraries listed below
Sorting:
- Apache DataFusion SQL Query Engine☆8,259Updated this week
- High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale☆5,098Updated last week
- Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.☆8,455Updated this week
- Distributed stream processing engine in Rust☆4,754Updated this week
- Event streaming platform for agents, apps, and analytics. Continuously ingest, transform, and serve event data in real time, at scale.☆8,700Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,945Updated this week
- Official Rust implementation of Apache Arrow☆3,314Updated this week
- An extensible, state of the art columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Li…☆2,479Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆4,010Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆3,094Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,526Updated 3 weeks ago
- Apache OpenDAL: One Layer, All Storage.☆4,818Updated this week
- One Warehouse for Analytics, Search, AI. Snowflake + Elasticsearch + Vector DB — rebuilt from scratch. Unified architecture on your S3.☆9,097Updated this week
- The live data layer for apps and AI agents Create up-to-the-second views into your business, just using SQL☆6,201Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,450Updated this week
- Making data lake work for time series☆1,188Updated last year
- Python Stream Processing☆1,931Updated 9 months ago
- Apache Iceberg☆1,193Updated this week
- Open-source, cloud-native, unified observability database for metrics, logs and traces, supporting SQL/PromQL/Streaming.☆5,887Updated this week
- Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.☆2,141Updated 10 months ago
- Embedded property graph database built for speed. Vector search and full-text search built in. Implements Cypher.☆3,575Updated 3 months ago
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,677Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,134Updated 2 weeks ago
- the portable Python dataframe library☆6,331Updated this week
- GlareDB: A light and fast SQL database for analytics☆990Updated 2 months ago
- Extensible SQL Lexer and Parser for Rust☆3,283Updated this week
- DuckLake is an integrated data lake and catalog format☆2,389Updated last week
- Postgres with GPUs for ML/AI apps.☆6,671Updated 6 months ago
- Fast Open-Source Search & Clustering engine × for Vectors & Arbitrary Objects × in C++, C, Python, JavaScript, Rust, Java, Objective-C, S…☆3,627Updated last week
- Apache DataFusion Comet Spark Accelerator☆1,102Updated this week