BloopAI / llmLinks
An ecosystem of Rust libraries for working with large language models
☆11Updated last year
Alternatives and similar repositories for llm
Users that are interested in llm are comparing it to the libraries listed below
Sorting:
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆47Updated 6 months ago
- Approx nearest neighbor search in Rust☆166Updated 2 years ago
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated last year
- Comparing performance-oriented string-processing libraries for substring search, multi-pattern matching, hashing, and Levenshtein edit-di…☆46Updated 2 weeks ago
- Write Ahead Logging for Rust☆32Updated 2 weeks ago
- A high-performance SPSC bounded circular buffer of bytes☆49Updated 2 months ago
- Rust client for txtai☆110Updated last week
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆62Updated last year
- Memory database☆55Updated last year
- 🦀Rust + Large Language Models - Make AI Services Freely and Easily.☆183Updated last year
- A low-level MVCC file format for storing blobs.☆64Updated last year
- ☆39Updated last year
- Unofficial Rust bindings to Apple's mlx framework☆184Updated 2 weeks ago
- scan-resistant concurrent lazy LRU☆61Updated 2 years ago
- Structured outputs for LLMs☆50Updated last year
- wait-configurable lock-free pub/sub event-bus☆30Updated 2 years ago
- Embedded Key-Value Storage Engine☆123Updated 3 months ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆75Updated last year
- log for concurrent workloads, with support for atomic batches and in-order recovery☆37Updated 3 years ago
- Dagcuter is a Rust library for executing Directed Acyclic Graphs (DAGs) of tasks. It manages task dependencies, detects circular dependen…☆32Updated last month
- Fast serverless LLM inference, in Rust.☆90Updated 6 months ago
- SQLite-based on-disk cache for Rust.☆23Updated last year
- ☆25Updated last year
- super simple in-memory blocking LSM for constant-size keys and values☆71Updated 6 months ago
- Rust DataFusion Server☆20Updated last week
- Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)☆121Updated 11 months ago
- Distributed stress testing framework in Rust☆116Updated 6 months ago
- Minimal example of using Tonic for client/server gRPC☆43Updated 6 months ago
- Lightning fast concurrent HyperLogLog for Rust.☆40Updated last month
- A Write Ahead Log (WAL) implementation in Rust☆230Updated last year