danielgrittner / llama2-rs
LLaMA2 + Rust
☆11Updated last year
Alternatives and similar repositories for llama2-rs:
Users that are interested in llama2-rs are comparing it to the libraries listed below
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆27Updated 6 months ago
- Rust implementation of Surya☆52Updated last month
- memchr vs stringzilla - up to 7x throughput difference between two SIMD-accelerated substring search libraries in Rust☆45Updated 7 months ago
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆46Updated 4 months ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆36Updated last month
- ☆24Updated 5 months ago
- git-like rag pipeline☆35Updated this week
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated 10 months ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆61Updated 7 months ago
- TensorRT-LLM server with Structured Outputs (JSON) built with Rust☆14Updated this week
- Rust port of llm.c by @karpathy☆38Updated 7 months ago
- Extract core logic from qdrant and make it available as a library.☆56Updated 7 months ago
- Tantivy directory implementation backed by object_store☆27Updated 10 months ago
- ☆36Updated last year
- 8-bit floating point types for Rust☆39Updated last month
- A data concurrency control key-value storage engine to Rustbase☆36Updated 5 months ago
- High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…☆67Updated 3 months ago
- ☆26Updated last week
- Data pipeline example written in Rust with Polars and DataFusion DataFrame package☆39Updated last year
- Mysql Change Data Capture Demo App for Fluvio Streaming Platform☆14Updated last year
- A high-performance matcher designed to solve LOGICAL and TEXT VARIATIONS problems in word matching, implemented in Rust.☆17Updated last week
- Bleeding edge low level Rust binding for GGML☆16Updated 5 months ago
- Rust DataFusion Server☆12Updated last month
- Bw-Tree for Rust☆23Updated last year
- HDFS based on Java implementation as a remote ObjectStore for DataFusion☆9Updated 9 months ago
- Modular, Asynchronous Implementation of a Log-Structured Merge Tree☆33Updated last month
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆55Updated last year
- ☆19Updated 4 months ago
- ☆49Updated 9 months ago