pykeio / diffusers
A modular Rust library for super fast Stable Diffusion inference - 45% faster than PyTorch ๐ฎ
โ177Updated 10 months ago
Related projects: โ
- Low rank adaptation (LoRA) for Candle.โ124Updated last month
- Stable Diffusion v1.4 ported to Rust's burn frameworkโ311Updated 6 months ago
- Stable Diffusion XL ported to Rust's burn frameworkโ248Updated 5 months ago
- Llama2 LLM ported to Rust burnโ272Updated 5 months ago
- An implementation of the diffusers api in Rustโ522Updated 5 months ago
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!โ100Updated last year
- High-level, optionally asynchronous Rust bindings to llama.cppโ161Updated 3 months ago
- Rust wrapper for Microsoft's ONNX Runtime (version 1.8)โ275Updated 6 months ago
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)โ235Updated last month
- The Google mediapipe AI library. Write AI inference applications for image recognition, text classification, audio / video processing andโฆโ141Updated last month
- Rust+OpenCL+AVX2 implementation of LLaMA inference codeโ537Updated 7 months ago
- Inference Llama 2 in one file of pure Rust ๐ฆโ227Updated last year
- A Rust implementation of OpenAI's Whisper model using the burn frameworkโ262Updated 4 months ago
- LLama.cpp rust bindingsโ320Updated 2 months ago
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rustโ79Updated 8 months ago
- โ134Updated this week
- A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit evaโฆโ92Updated last year
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python packageโ138Updated 3 weeks ago
- ncnn Rust API.โ38Updated 9 months ago
- Example of tch-rs on M1โ47Updated 6 months ago
- Rust bindings for OpenVINOโขโ82Updated last month
- Models and examples built with Burnโ162Updated this week
- A Discord bot, written in Rust, that generates responses using the LLaMA language model.โ91Updated last year
- An extension library to Candle that provides PyTorch functions not currently available in Candleโ35Updated 6 months ago
- โ57Updated last year
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.โ229Updated 3 weeks ago
- Safe wrapper around the Coqui STT C libraryโ108Updated last year
- Rust client for Qdrant vector search engineโ217Updated 3 weeks ago
- Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.โ34Updated last year
- pure rust implementaion for deep learning library like kerasโ58Updated last year