danielgrittner / llama2-rs
LLaMA2 + Rust
☆12Updated last year
Alternatives and similar repositories for llama2-rs
Users that are interested in llama2-rs are comparing it to the libraries listed below
Sorting:
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆36Updated last year
- ☆25Updated 10 months ago
- 8-bit floating point types for Rust☆47Updated last month
- ☆13Updated last year
- AI Assistant☆20Updated 3 weeks ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆46Updated 2 months ago
- 💃 Kafka/Raft implementation in Rust☆28Updated last month
- Bw-Tree for Rust☆27Updated last year
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated last year
- Rust implementation of Surya☆58Updated 2 months ago
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆61Updated 10 months ago
- Rust bindings for OpenNMT/CTranslate2☆31Updated 3 weeks ago
- Extract core logic from qdrant and make it available as a library.☆58Updated last year
- Toy NN LIB☆22Updated 2 months ago
- A high-performance RAG indexing pipeline implemented in Rust using LanceDB and Candle☆14Updated 9 months ago
- Comparing performance-oriented string-processing libraries for substring search, multi-pattern matching, hashing, and Levenshtein edit-di…☆46Updated last month
- The MCP enterprise actors-based server or mcp-ectors for short☆29Updated last month
- Mysql Change Data Capture Demo App for Fluvio Streaming Platform☆14Updated last year
- Tantivy directory implementation backed by object_store☆33Updated last year
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆71Updated last year
- ☆29Updated 5 months ago
- High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…☆82Updated last month
- Proof of concept for running moshi/hibiki using webrtc☆18Updated 2 months ago
- A collection of boosting algorithms written in Rust 🦀☆53Updated 3 months ago
- A Rust Vector which swaps to disk based on given parameters☆44Updated last year
- ☆49Updated last year
- Run LLaMA inference on CPU, with Rust 🦀🚀🦙☆26Updated 4 months ago
- Minimalistic Rust Implementation Of Model Context Protocol from Anthropic☆56Updated last month
- Bleeding edge low level Rust binding for GGML☆16Updated 10 months ago
- Official repository for Databend documentation☆16Updated this week