rustformers / llmLinks
[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
☆6,122Updated last year
Alternatives and similar repositories for llm
Users that are interested in llm are comparing it to the libraries listed below
Sorting:
- Minimalist ML framework for Rust☆17,539Updated 2 weeks ago
- Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)☆2,895Updated last month
- Rust bindings for the C++ api of PyTorch.☆4,889Updated last month
- Burn is a next generation Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.☆11,480Updated last week
- Blazingly fast LLM inference.☆5,849Updated this week
- A fast llama2 decoder in pure Rust.☆1,050Updated last year
- A Rust machine learning framework.☆4,227Updated this week
- Instant, controllable, local pre-trained AI models in Rust☆1,925Updated last week
- Deep learning in Rust, with shape checked tensors and neural networks☆1,827Updated 11 months ago
- A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web☆1,730Updated 11 months ago
- Tensor library for machine learning☆12,808Updated this week
- Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.☆4,521Updated this week
- Locally run an Instruction-Tuned Chat-Style LLM☆10,226Updated 2 years ago
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,700Updated 10 months ago
- Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference☆2,514Updated this week
- Rust library for OpenAI☆1,508Updated last week
- `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tas…☆1,515Updated 8 months ago
- A full-featured and easy-to-use web framework with the Rust programming language.☆4,060Updated this week
- ☆6,090Updated 3 weeks ago
- Rayon: A data parallelism library for Rust☆11,926Updated 3 months ago
- Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU☆3,820Updated last year
- Makepad is a creative software development platform for Rust that compiles to wasm/webGL, osx/metal, windows/dx11 linux/opengl☆5,798Updated this week
- This repository is a list of machine learning libraries written in Rust. It's a compilation of GitHub repositories, blogs, books, movies,…☆2,140Updated last year
- Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.☆3,670Updated last year
- Running large language models on a single GPU for throughput-oriented scenarios.☆9,341Updated 8 months ago
- Spin is the open source developer tool for building and running serverless applications powered by WebAssembly.☆5,965Updated this week
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,505Updated last year
- An embedded key-value database in pure Rust☆3,782Updated this week
- Build & ship backends without writing any infrastructure files.☆6,563Updated this week
- Rust+OpenCL+AVX2 implementation of LLaMA inference code☆549Updated last year