BloopAI / llmLinks
An ecosystem of Rust libraries for working with large language models
☆12Updated 2 years ago
Alternatives and similar repositories for llm
Users that are interested in llm are comparing it to the libraries listed below
Sorting:
- A high-performance SPSC bounded circular buffer of bytes☆51Updated 6 months ago
- Memory database☆58Updated last year
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆47Updated 10 months ago
- 🦀Rust + Large Language Models - Make AI Services Freely and Easily.☆182Updated last year
- Write Ahead Logging for Rust☆38Updated this week
- Approx nearest neighbor search in Rust☆165Updated 2 years ago
- ☆39Updated 2 years ago
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆64Updated last year
- super simple in-memory blocking LSM for constant-size keys and values☆73Updated 10 months ago
- A low-level MVCC file format for storing blobs.☆64Updated last year
- Rust client for txtai☆113Updated last week
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆79Updated last year
- scan-resistant concurrent lazy LRU☆63Updated 2 years ago
- Starlane makes it easy to deploy and interoperate with secure WebAssembly code in the cloud, the edge, desktop, mobile and IoT environmen…☆105Updated 2 months ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆77Updated last year
- wait-configurable lock-free pub/sub event-bus☆35Updated 3 years ago
- Yet another key-value storage for Rust☆72Updated 4 years ago
- memflow I/O primitives☆82Updated 8 months ago
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆111Updated 2 years ago
- heap profiler for rust☆28Updated 3 weeks ago
- Rust DataFusion Server☆25Updated 2 weeks ago
- Comparing performance-oriented string-processing libraries for substring search, multi-pattern matching, hashing, edit-distances, sketchi…☆134Updated 2 weeks ago
- Common Rust library☆52Updated 2 months ago
- log for concurrent workloads, with support for atomic batches and in-order recovery☆37Updated 3 years ago
- A flexible and convenient high-level mmap for zero-copy file I/O.☆117Updated 10 months ago
- Bleeding edge low level Rust binding for GGML☆16Updated last year
- Percas is a distributed PERsistent CAche Service.☆100Updated 3 weeks ago
- Rust client library for ClickHouse☆17Updated 2 years ago
- Orkhon: ML Inference Framework and Server Runtime☆151Updated 4 years ago
- Framework to build data pipelines declaratively☆93Updated 3 weeks ago