nelhage / transformer-rs
A sketch of a Transformer in Rust for a blog post
☆31Updated 3 years ago
Alternatives and similar repositories for transformer-rs:
Users that are interested in transformer-rs are comparing it to the libraries listed below
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆38Updated last year
- Experimental compiler for deep learning models☆62Updated last week
- ☆26Updated last year
- ☆59Updated 2 years ago
- Modular Rust transformer/LLM library using Candle☆36Updated 11 months ago
- Implementing the BitNet model in Rust☆31Updated last year
- ☆23Updated last year
- A high-performance constrained decoding engine based on context free grammar in Rust☆50Updated 3 months ago
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆104Updated last year
- Experimentation using the xla compiler from rust☆91Updated 8 months ago
- Sample Python extension using Rust/PyO3/tch to interact with PyTorch☆34Updated last year
- Standalone commandline CLI tool for compiling Triton kernels☆17Updated 7 months ago
- implement llava using candle☆14Updated 10 months ago
- LLaMA from First Principles☆51Updated last year
- Tensor library with autograd using only Rust's standard library☆67Updated 9 months ago
- Tensor library for Zig☆11Updated 5 months ago
- ☆128Updated 11 months ago
- Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)☆24Updated 2 years ago
- ☆28Updated 5 months ago
- ☆18Updated last year
- Generic Automatic Differentiation library for Rust (aka "autograd")☆38Updated 3 years ago
- "PyTorch in Rust"☆16Updated last year
- Rust Implementation of micrograd☆51Updated 9 months ago
- Dataflow is a data processing library, primarily for machine learning.☆20Updated last year
- ☆12Updated last year
- A collection of optimisers for use with candle☆34Updated 5 months ago
- ☆85Updated 3 months ago
- Make triton easier☆47Updated 10 months ago
- ☆155Updated 2 years ago
- 8-bit floating point types for Rust☆46Updated last month