⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
☆6,018Nov 12, 2026Updated this week
Alternatives and similar repositories for shimmy
Users that are interested in shimmy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fast, small, and fully autonomous AI personal assistant infrastructure, any OS, any platform — deploy anywhere, swap anything 🦀☆33,378Updated this week
- The headless browser for AI agents and web scraping☆36,178Updated this week
- A lightweight, lightning-fast, in-process vector database☆16,257Updated this week
- Open-source Agent Operating System☆18,256Jul 2, 2026Updated 4 months ago
- Rust GUI components for building fantastic cross-platform desktop application by using GPUI.☆20,911Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compati…☆36,209Updated this week
- Open-Source Frontier Voice AI☆57,229Oct 8, 2026Updated last month
- Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval…☆17,426Jul 14, 2026Updated 4 months ago
- VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning☆42,585Nov 9, 2026Updated last week
- Lightpanda: the headless browser designed for AI and automation☆42,181Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆79,678Updated this week
- LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.☆50,416Updated this week
- Fast, flexible LLM inference☆7,845Nov 9, 2026Updated last week
- A secure persistent personal agent server in Rust. One binary, sandboxed execution, multi-provider LLMs, voice, memory, Telegram, WhatsAp…☆2,970Oct 23, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra☆39,602Oct 9, 2026Updated last month
- Python tool for converting files and office documents to Markdown.☆196,005Nov 7, 2026Updated last week
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆56,718Updated this week
- Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.☆37,651Updated this week
- Comfortably monitor your network traffic 🕵️♂️☆43,006Updated this week
- Rust multi‑backend OCR/VLM engine (DeepSeek‑OCR-1/2, PaddleOCR‑VL, DotsOCR) with DSQ quantization and an OpenAI‑compatible server & CLI –…☆2,186Feb 21, 2026Updated 8 months ago
- 🔥 Clone and recreate any website as a modern React app in seconds☆28,919Oct 9, 2026Updated last month
- Portable DNS resolver in Rust: .numa local domains, ad blocking, developer overrides, DoT/DoH/ODoH, DNSSEC☆1,980Updated this week
- Turn any website into a lightweight desktop app with one command, on macOS, Windows and Linux.☆63,737Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, s…☆85,443Updated this week
- A SQL database in Rust: SQLite-compatible, now also speaking Postgres (experimental). The LLVM of databases.☆25,279Updated this week
- Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.☆32,503Updated this week
- ⚙️🦀 Build modular and scalable LLM Applications in Rust☆9,165Updated this week
- Per-process network monitoring for your terminal with deep packet inspection. Cross-platform, sandboxed.☆5,243Updated this week
- Your AI workspace for models, agents, and productivity.☆53,596Updated this week
- Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.☆83,824Updated this week
- Real-time, local speech-to-text with streaming ASR, speaker diarization, translation, and OpenAI/Deepgram-compatible APIs.☆11,258Updated this week
- AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI☆122,514Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 25 MB lightweight cross-platform database client for 100+ databases, including MySQL, PostgreSQL, SQLite, Redis, MongoDB, DuckDB, SQL Ser…☆30,618Updated this week
- The fastest, cheapest, most efficient open-source agent harness. Run more than 500 agents on a $10 VPS.☆42,732Updated this week
- LLM inference in C/C++☆135,573Updated this week
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆63,423Updated this week
- Official inference framework for 1-bit LLMs☆41,594Jul 27, 2026Updated 3 months ago
- 🧠 Train a 64M-parameter LLM from scratch in just 2h!☆65,956Oct 27, 2026Updated 3 weeks ago
- Minimalist ML framework for Rust☆21,340Updated this week
Are these results useful?