BloopAI / llm
An ecosystem of Rust libraries for working with large language models
☆11Updated last year
Related projects ⓘ
Alternatives and complementary repositories for llm
- memchr vs stringzilla - up to 7x throughput difference between two SIMD-accelerated substring search libraries in Rust☆45Updated 6 months ago
- Vemcache is an in-memory vector database.☆34Updated 2 months ago
- This tool provides a fast and efficient way to convert text into vector embeddings and store them in the Qdrant search engine. Built with…☆14Updated last year
- spotify/annoy bindings for Rust.☆18Updated last year
- Rust FFI example binding for chDB, an embedded SQL Engine powered by ClickHouse☆29Updated 2 months ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆35Updated 3 weeks ago
- Rust port of llm.c by @karpathy☆37Updated 6 months ago
- Memory database☆54Updated 7 months ago
- Distributed, fault tolerant, strongly consistent, performant (event)log in Rust☆16Updated last year
- Thread-safe clone-on-write container for fast concurrent writing and reading.☆49Updated last year
- Tantivy directory implementation backed by object_store☆27Updated 9 months ago
- An eventually consistent LRU designed for lock-free concurrent reads☆22Updated last year
- ☆25Updated last year
- Unofficial Rust bindings to Apple's mlx framework☆64Updated this week
- Provides utilities for collecting Prometheus-compatible metrics from Tokio runtime and tasks.☆29Updated last month
- Inference Llama 2 in one file of pure C☆14Updated last year
- This is a small demo of how to transform a simple single-server RocksDB service written in Rust into a distributed version using OmniPaxo…☆15Updated last year
- High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…☆65Updated 3 months ago
- scan-resistant concurrent lazy LRU☆57Updated last year
- Hash Array Mapped Trie (HAMT) and Ctrie Implementations for Rust☆10Updated 2 years ago
- Value log implementation for key-value separated storage in safe Rust☆21Updated last week
- Accompanying source code for the article: How to build a Semantic Search Engine in Rust☆24Updated 2 years ago
- Bleeding edge low level Rust binding for GGML☆16Updated 4 months ago
- A low-level MVCC file format for storing blobs.☆63Updated 8 months ago
- Rust LLM Stream Analyzer and Content Generator☆16Updated 5 months ago
- axum::ws with type safe messages☆21Updated 5 months ago
- ☆20Updated 11 months ago
- Structured outputs for LLMs☆30Updated 3 months ago
- Generic k-means implementation written in Rust☆14Updated 4 years ago
- Command-line tool to make Rust source code entities from Postgres tables.☆10Updated 2 years ago