srush / llama2.rsLinks
A fast llama2 decoder in pure Rust.
☆1,059Updated 2 years ago
Alternatives and similar repositories for llama2.rs
Users that are interested in llama2.rs are comparing it to the libraries listed below
Sorting:
- Rust+OpenCL+AVX2 implementation of LLaMA inference code☆554Updated 2 years ago
- Pure Rust implementation of a minimal Generative Pretrained Transformer☆936Updated 3 months ago
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)☆338Updated last year
- LLama.cpp rust bindings☆414Updated last year
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆591Updated 2 weeks ago
- Inference Llama 2 in one file of pure Rust 🦀☆235Updated 2 years ago
- An implementation of the diffusers api in Rust☆584Updated last year
- A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web☆1,747Updated last year
- A cross-platform browser ML framework.☆746Updated last year
- Deep learning in Rust, with shape checked tensors and neural networks☆1,893Updated last year
- LLM Orchestrator built in Rust☆284Updated last year
- Inference Llama 2 in one file of pure 🔥☆2,116Updated 2 months ago
- 🦀 A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AI☆527Updated last year
- [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models☆6,146Updated last year
- ☆135Updated last year
- Llama2 LLM ported to Rust burn☆279Updated last year
- Rust bindings to https://github.com/ggerganov/whisper.cpp☆933Updated 6 months ago
- High-level, optionally asynchronous Rust bindings to llama.cpp☆241Updated last year
- `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tas…☆1,593Updated last year
- Stable Diffusion v1.4 ported to Rust's burn framework☆342Updated last year
- Rust library for vector embeddings and reranking.☆754Updated 3 weeks ago
- ☆453Updated last week
- Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)☆3,033Updated 3 weeks ago
- Rust library for OpenAI☆1,753Updated 2 weeks ago
- AICI: Prompts as (Wasm) Programs☆2,061Updated last year
- Ready-made tokenizer library for working with GPT and tiktoken☆368Updated last week
- OpenAI API client library for Rust (unofficial)☆475Updated last month
- Deep learning at the speed of light.☆2,767Updated this week
- A Rust implementation of OpenAI's Whisper model using the burn framework☆340Updated last year
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆260Updated 3 weeks ago