nelhage / transformer-rsLinks
A sketch of a Transformer in Rust for a blog post
☆34Updated 3 years ago
Alternatives and similar repositories for transformer-rs
Users that are interested in transformer-rs are comparing it to the libraries listed below
Sorting:
- Modular Rust transformer/LLM library using Candle☆36Updated last year
- ☆135Updated last year
- Experimental compiler for deep learning models☆70Updated 2 months ago
- LLaMA from First Principles☆51Updated 2 years ago
- Experimentation using the xla compiler from rust☆98Updated last year
- ☆58Updated 2 years ago
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆39Updated 2 years ago
- ☆157Updated 2 years ago
- A high-performance constrained decoding engine based on context free grammar in Rust☆55Updated 5 months ago
- Sample Python extension using Rust/PyO3/tch to interact with PyTorch☆38Updated last year
- ☆28Updated 2 years ago
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆110Updated 2 years ago
- Locality Sensitive Hashing in Rust with Python bindings☆119Updated 2 years ago
- Inference Llama 2 in one file of pure Rust 🦀☆233Updated 2 years ago
- Dataflow is a data processing library, primarily for machine learning.☆24Updated 2 years ago
- A collection of optimisers for use with candle☆43Updated 3 months ago
- Locality Sensitive Hashing☆74Updated 2 years ago
- l2 is a fast, Pytorch-style Tensor+Autograd library written in Rust☆197Updated 2 years ago
- ☆23Updated 2 years ago
- This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback☆111Updated 8 months ago
- A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit eva…☆94Updated 2 years ago
- Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (…☆327Updated 2 years ago
- A diffusers API in Burn (Rust)☆22Updated last year
- Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)☆24Updated 3 years ago
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.☆78Updated 2 years ago
- Your one stop CLI for ONNX model analysis.☆47Updated 3 years ago
- ☆32Updated 2 years ago
- LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence☆60Updated 3 years ago
- wasm bindings for huggingface tokenizers library☆34Updated 3 years ago
- RWKV model implementation☆38Updated 2 years ago