danielgrittner / llama2-rsLinks
LLaMA2 + Rust
☆12Updated 2 years ago
Alternatives and similar repositories for llama2-rs
Users that are interested in llama2-rs are comparing it to the libraries listed below
Sorting:
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆47Updated last year
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆48Updated 11 months ago
- Extract core logic from qdrant and make it available as a library.☆63Updated last year
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆65Updated last year
- Library for doing RAG☆82Updated last month
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆76Updated last year
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆79Updated 2 years ago
- Approx nearest neighbor search in Rust☆165Updated 2 years ago
- A RAG API server written in Rust following OpenAI specs☆60Updated 9 months ago
- Fast serverless LLM inference, in Rust.☆109Updated 2 months ago
- ReefDB is a minimalistic, in-memory and on-disk database management system written in Rust, implementing basic SQL query capabilities and…☆90Updated 3 weeks ago
- 🦀Rust + Large Language Models - Make AI Services Freely and Easily.☆182Updated last year
- High-performance framework for building interactive multi-agent workflow systems in Rust☆234Updated 2 months ago
- A high-performance RAG indexing pipeline implemented in Rust using LanceDB and Candle☆25Updated last year
- Rust implementation of Surya☆65Updated 11 months ago
- 8-bit floating point types for Rust☆61Updated last week
- 🦀 A Pure Rust Framework For Building AGI (WIP).☆111Updated 2 weeks ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆242Updated 5 months ago
- ChronoMind: Redefining Vector Intelligence Through Time.☆73Updated 9 months ago
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…☆139Updated last year
- ☆30Updated last year
- ☆27Updated last year
- High performance embedded vector database☆193Updated last week
- AI Assistant☆20Updated 9 months ago
- bott: Your Terminal Copilot☆87Updated 2 years ago
- Minimalistic Rust Implementation Of Model Context Protocol from Anthropic☆63Updated 6 months ago
- Rust language bindings for Faiss☆246Updated 2 months ago
- Inference Llama 2 in one file of pure Rust 🦀☆235Updated 2 years ago
- implement llava using candle☆15Updated last year
- Implementing the BitNet model in Rust☆44Updated last year