nerdai / llms-from-scratch-rs
A comprehensive Rust translation of the code from Sebastian Raschka's Build an LLM from Scratch book.
☆18Updated this week
Alternatives and similar repositories for llms-from-scratch-rs:
Users that are interested in llms-from-scratch-rs are comparing it to the libraries listed below
- Unofficial Rust bindings to Apple's mlx framework☆71Updated this week
- 8-bit floating point types for Rust☆40Updated this week
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆28Updated 8 months ago
- Library for doing RAG☆48Updated 3 weeks ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆41Updated 2 months ago
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated 11 months ago
- Run Generative AI models directly on your hardware☆25Updated 5 months ago
- Structured outputs for LLMs☆32Updated 5 months ago
- Fast serverless LLM inference, in Rust.☆50Updated this week
- Rust implementation of Surya☆55Updated last week
- Comparing performance-oriented string-processing libraries for substring search, multi-pattern matching, hashing, and Levenshtein edit-di…☆45Updated last month
- Graph model execution API for Candle☆10Updated last month
- Your AI Copilot in Rust☆46Updated last year
- Low rank adaptation (LoRA) for Candle.☆133Updated 4 months ago
- ☆17Updated 3 months ago
- GGML bindings that aim to be idiomatic Rust rather than directly corresponding to the C/C++ interface☆19Updated last year
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆63Updated 9 months ago
- 🦀 A Pure Rust Framework For Building AGI (WIP).☆35Updated 8 months ago
- TensorRT-LLM server with Structured Outputs (JSON) built with Rust☆21Updated this week
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆37Updated 9 months ago
- ☆25Updated last month
- auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing…☆34Updated last month
- Implementing the BitNet model in Rust☆29Updated 8 months ago
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆37Updated last year
- Modular Rust transformer/LLM library using Candle☆36Updated 8 months ago
- A diffusers API in Burn (Rust)☆16Updated 5 months ago
- High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…☆71Updated 5 months ago
- Rust Vector for large amounts of data, that does not copy when growing, by using full `mmap`'d pages.☆22Updated 9 months ago
- A collection of optimisers for use with candle☆31Updated last month