nelhage / transformer-rsLinks
A sketch of a Transformer in Rust for a blog post
☆34Updated 3 years ago
Alternatives and similar repositories for transformer-rs
Users that are interested in transformer-rs are comparing it to the libraries listed below
Sorting:
- ☆134Updated last year
- Modular Rust transformer/LLM library using Candle☆37Updated last year
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆39Updated 2 years ago
- ☆58Updated 2 years ago
- Sample Python extension using Rust/PyO3/tch to interact with PyTorch☆40Updated last year
- A high-performance constrained decoding engine based on context free grammar in Rust☆57Updated 7 months ago
- Experimental compiler for deep learning models☆73Updated 3 months ago
- Dataflow is a data processing library, primarily for machine learning.☆24Updated 2 years ago
- l2 is a fast, Pytorch-style Tensor+Autograd library written in Rust☆197Updated 3 years ago
- Experimentation using the xla compiler from rust☆99Updated last year
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.☆80Updated 2 years ago
- LLaMA from First Principles☆51Updated 2 years ago
- Locality Sensitive Hashing in Rust with Python bindings☆120Updated 2 years ago
- Inference Llama 2 in one file of pure Rust 🦀☆235Updated 2 years ago
- Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)☆24Updated 3 years ago
- ☆157Updated 2 years ago
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆111Updated 2 years ago
- Experiments for efforts to train a new and improved t5☆76Updated last year
- ☆28Updated 2 years ago
- Generic, parallel Monte Carlo tree search library☆76Updated 3 years ago
- A collection of optimisers for use with candle☆45Updated last week
- Your one stop CLI for ONNX model analysis.☆47Updated 3 years ago
- Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (…☆331Updated 2 years ago
- RAI: Rust ML framework with composable transformations like JAX.☆95Updated last year
- Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…☆40Updated 3 months ago
- It's a baby compiler. (Lean btw.)☆16Updated 7 months ago
- A neural network library written from scratch in Rust along with a web-based application for building + training neural networks + visual…☆138Updated last year
- Doing advent of code with CUDA and rust.☆205Updated last year
- This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback☆114Updated 10 months ago
- An interactive exploration of Transformer programming.☆271Updated 2 years ago