ljt019 / transformersLinks
Transformers provides a simple, intuitive interface for Rust developers who want to work with Large Language Models locally, powered by the Candle crate. It offers an API inspired by Python's Transformers, tailored for Rust developers.
☆16Updated this week
Alternatives and similar repositories for transformers
Users that are interested in transformers are comparing it to the libraries listed below
Sorting:
- Fast, Lightweight, Unified Engine for Text2Image Diffusion Models☆20Updated 2 months ago
- A collection of optimisers for use with candle☆36Updated last month
- Rust standalone inference of Namo-500M series models. Extremly tiny, runing VLM on CPU.☆24Updated 3 months ago
- implement llava using candle☆15Updated last year
- Port of Andrej Karpathy's minbpe to Rust☆23Updated last year
- 8-bit floating point types for Rust☆46Updated 3 months ago
- Low rank adaptation (LoRA) for Candle.☆150Updated 2 months ago
- ☆11Updated 4 months ago
- CLI utility to inspect and explore .safetensors and .gguf files☆18Updated last week
- A Fish Speech implementation in Rust, with Candle.rs☆91Updated 2 weeks ago
- Tensor library for Zig☆11Updated 7 months ago
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated last year
- ☆30Updated 7 months ago
- GPU based FFT written in Rust and CubeCL☆23Updated 2 weeks ago
- Cookbook to build Rust Candle models☆79Updated last year
- Rust crate for some audio utilities☆24Updated 3 months ago
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆37Updated last year
- Experimental compiler for deep learning models☆67Updated last month
- ☆20Updated 8 months ago
- This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback☆95Updated 3 months ago
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆209Updated last week
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆39Updated last year
- Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.☆131Updated last month
- ☆23Updated 2 months ago
- Library for doing RAG☆74Updated last month
- A small rust-based data loader☆27Updated 2 weeks ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆72Updated last year
- Unofficial Rust bindings to Apple's mlx framework☆158Updated 2 weeks ago
- ONNX neural network inference engine☆215Updated this week
- Implementation of the Coursera ML course in Rust☆38Updated 4 months ago