huggingface / ratchetLinks
A cross-platform browser ML framework.
β702Updated 6 months ago
Alternatives and similar repositories for ratchet
Users that are interested in ratchet are comparing it to the libraries listed below
Sorting:
- High-level, optionally asynchronous Rust bindings to llama.cppβ221Updated last year
- πΈοΈπ¦ A WASM vector similarity search written in Rustβ976Updated last year
- β299Updated this week
- LLama.cpp rust bindingsβ390Updated 11 months ago
- A Rust implementation of OpenAI's Whisper model using the burn frameworkβ312Updated last year
- Rust library for generating vector embeddings, reranking.β533Updated last week
- LLM Orchestrator built in Rustβ278Updated last year
- A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the webβ1,728Updated 11 months ago
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inferenceβ750Updated 2 weeks ago
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.β376Updated last week
- Minimal LLM inference in Rustβ994Updated 7 months ago
- β137Updated last year
- Low rank adaptation (LoRA) for Candle.β147Updated 2 months ago
- Rust+OpenCL+AVX2 implementation of LLaMA inference codeβ549Updated last year
- A fast llama2 decoder in pure Rust.β1,051Updated last year
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)β298Updated 11 months ago
- Stateful load balancer custom-tailored for llama.cpp ππ¦β779Updated this week
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibesβ203Updated 4 months ago
- Inference Llama 2 in one file of pure Rust π¦β233Updated last year
- Unofficial Rust bindings to Apple's mlx frameworkβ158Updated last week
- Rust bindings to https://github.com/ggerganov/whisper.cppβ871Updated 2 weeks ago
- Ready-made tokenizer library for working with GPT and tiktokenβ313Updated last month
- Blazingly fast LLM inference.β5,742Updated this week
- An implementation of the diffusers api in Rustβ556Updated last year
- A tiny embedding database in pure Rust.β411Updated last year
- Llama2 LLM ported to Rust burnβ278Updated last year
- Fast, streaming indexing, query, and agentic LLM applications in Rustβ507Updated this week
- Fast ML inference & training for ONNX models in Rustβ1,360Updated last week
- Stable Diffusion v1.4 ported to Rust's burn frameworkβ334Updated 8 months ago
- π¦ A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AIβ425Updated last year