nelhage / transformer-rs
A sketch of a Transformer in Rust for a blog post
☆29Updated 2 years ago
Alternatives and similar repositories for transformer-rs:
Users that are interested in transformer-rs are comparing it to the libraries listed below
- Experimental compiler for deep learning models☆26Updated this week
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆37Updated last year
- A high-performance constrained decoding engine based on context free grammar in Rust☆46Updated last month
- LLaMA from First Principles☆51Updated last year
- Implementing the BitNet model in Rust☆30Updated 10 months ago
- ☆125Updated 9 months ago
- ☆57Updated last year
- Modular Rust transformer/LLM library using Candle☆36Updated 9 months ago
- ☆25Updated last year
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆102Updated last year
- Experimentation using the xla compiler from rust☆91Updated 6 months ago
- RAI: Rust ML framework with composable transformations like JAX.☆84Updated 7 months ago
- ☆19Updated 4 months ago
- ☆21Updated 7 months ago
- A programming language for formal/informal computation.☆41Updated this week
- ☆12Updated last year
- Sample Python extension using Rust/PyO3/tch to interact with PyTorch☆34Updated last year
- Experiments for efforts to train a new and improved t5☆77Updated 10 months ago
- Generic Automatic Differentiation library for Rust (aka "autograd")☆37Updated 3 years ago
- ☆28Updated 3 months ago
- ☆18Updated 10 months ago
- Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code☆10Updated last year
- Unofficial Rust bindings to Apple's mlx framework☆126Updated this week
- Locality Sensitive Hashing in Rust with Python bindings☆113Updated last year
- implement llava using candle☆14Updated 8 months ago
- Experimental ONNX implementation for WASI NN.☆48Updated 3 years ago
- Inference Llama 2 in one file of pure Rust 🦀☆231Updated last year
- Rust bindings to GAP (Groups, Algorithms, Programming)☆18Updated last year
- Super-fast Structured Outputs☆114Updated this week
- A collection of optimisers for use with candle☆34Updated 3 months ago