rustformers / llmLinks
[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
☆6,129Updated last year
Alternatives and similar repositories for llm
Users that are interested in llm are comparing it to the libraries listed below
Sorting:
- Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)☆2,930Updated 2 months ago
- A fast llama2 decoder in pure Rust.☆1,055Updated last year
- Minimalist ML framework for Rust☆17,857Updated last week
- Rust bindings for the C++ api of PyTorch.☆4,955Updated 2 weeks ago
- Burn is a next generation Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.☆12,604Updated last week
- Deep learning in Rust, with shape checked tensors and neural networks☆1,834Updated last year
- A Rust machine learning framework.☆4,276Updated last month
- Blazingly fast LLM inference.☆6,027Updated last week
- A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web☆1,736Updated last year
- Instant, controllable, local pre-trained AI models in Rust☆1,984Updated last week
- `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tas…☆1,534Updated 9 months ago
- Tensor library for machine learning☆13,052Updated this week
- Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.☆4,633Updated this week
- Rust library for OpenAI☆1,566Updated this week
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,763Updated 11 months ago
- This repository is a list of machine learning libraries written in Rust. It's a compilation of GitHub repositories, blogs, books, movies,…☆2,163Updated last year
- Rust+OpenCL+AVX2 implementation of LLaMA inference code☆548Updated last year
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,518Updated 2 years ago
- Pure Rust implementation of a minimal Generative Pretrained Transformer☆914Updated last month
- Locally run an Instruction-Tuned Chat-Style LLM☆10,213Updated 2 years ago
- Fast ML inference & training for ONNX models in Rust☆1,514Updated this week
- Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference☆2,549Updated this week
- Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.☆3,678Updated last year
- Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU☆3,820Updated last year
- Home of StarCoder: fine-tuning & inference!☆7,446Updated last year
- An embedded key-value database in pure Rust☆3,917Updated 2 weeks ago
- ☆6,134Updated last month
- Deep learning at the speed of light.☆2,098Updated this week
- The RedPajama-Data repository contains code for preparing large datasets for training large language models.☆4,798Updated 8 months ago
- Running large language models on a single GPU for throughput-oriented scenarios.☆9,356Updated 9 months ago