lancedb / lance
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
☆3,789Updated this week
Related projects: ⓘ
- Distributed DataFrame for Python designed for the cloud, powered by Rust☆2,080Updated this week
- Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!☆4,113Updated this week
- Making data lake work for time series☆1,121Updated 3 weeks ago
- Apache DataFusion SQL Query Engine☆5,913Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆2,155Updated this week
- Distributed stream processing engine in Rust☆3,627Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,468Updated this week
- Postgres with GPUs for ML/AI apps.☆5,896Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆1,968Updated last month
- Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.☆1,664Updated 2 weeks ago
- Python Stream Processing☆1,467Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆1,933Updated this week
- the portable Python dataframe library☆5,064Updated this week
- Postgres for Search and Analytics☆5,819Updated this week
- A transactional, relational-graph-vector database that uses Datalog for query. The hippocampus for AI!☆3,346Updated last month
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,793Updated this week
- Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metada…☆1,723Updated this week
- Apache OpenDAL: access data freely.☆3,239Updated last week
- Hydra: Column-oriented Postgres. Add scalable analytics to your project in minutes.☆2,800Updated last month
- Official Rust implementation of Apache Arrow☆2,463Updated this week
- Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.☆1,639Updated this week
- Efficient data transformation and modeling framework that is backwards compatible with dbt.☆1,612Updated this week
- The Cloud Operational Data Store: use SQL to transform, deliver, and act on fast-changing data.☆5,723Updated this week
- Malloy is an experimental language for describing data relationships and transformations.☆1,953Updated this week
- GlareDB: An analytics DBMS for distributed data☆638Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,167Updated this week
- Embeddable property graph database management system built for query speed and scalability. Implements Cypher.☆1,277Updated this week
- The Open Source Feature Store for Machine Learning☆5,476Updated this week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆1,779Updated this week
- Best-in-class stream processing, analytics, and management. Perform continuous analytics, or build event-driven applications, real-time E…☆6,783Updated this week