An educational Rust project for exporting and running inference on Qwen3 LLM family
☆44Aug 3, 2025Updated last year
Alternatives and similar repositories for qwen3-rs
Users that are interested in qwen3-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inspect LLM's logprobs and perplexity over a piece of text, or compare two LLMs (like a git diff)☆18Aug 3, 2026Updated last month
- Multi-agent orchestration framework for AI applications - build, deploy, and manage AI agents across the full lifecycle with Forge, Conve…☆33Mar 28, 2026Updated 5 months ago
- ☆42Aug 2, 2025Updated last year
- A miniaturized version of the Kimi-K2 model optimized for deployment on single H100 GPUs.☆36Jul 16, 2025Updated last year
- Zero-instrumentation LLM API and MCP tracer for your agents powered by eBPF — latency, tokens, and tool use in realtime☆18Mar 16, 2026Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆18Dec 1, 2025Updated 9 months ago
- ☆42Jul 13, 2026Updated 2 months ago
- ☆16Feb 1, 2025Updated last year
- A MCP stdio toolpack for local LLMs☆34Apr 6, 2026Updated 5 months ago
- DocFinder is a local-first indexing and searching documents using semantic embeddings stored in SQLite. Everything runs on your machine, …☆33Updated this week
- A Prometheus metrics exporter for NVIDIA DGX Spark clusters.☆25Feb 16, 2026Updated 7 months ago
- ☆20Jan 3, 2026Updated 8 months ago
- Generate Duolingo-style quiz courses from PDFs with spaced repetition, adaptive difficulty, and tutor chat.☆18Apr 6, 2026Updated 5 months ago
- MiniLM (BERT) embeddings from scratch☆21Aug 14, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- RUST 哔哩哔哩客户端☆18Jun 19, 2023Updated 3 years ago
- ☆21Jul 4, 2025Updated last year
- A Chrome extension that enables virtual fashion try-on and model swap using FASHN AI. Hover over fashion images on any website to: (1) tr…☆22Aug 14, 2025Updated last year
- ☆45Sep 20, 2026Updated last week
- Load and run Llama from safetensors files in C☆16Oct 24, 2024Updated last year
- Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.☆209Jul 5, 2025Updated last year
- Protocol for Augmented Memory of Project Artifacts (MCP compatible) - extended☆23Jan 24, 2026Updated 8 months ago
- ☆24Jan 22, 2025Updated last year
- A sleek web interface for Ollama, making local LLM management and usage simple. WebOllama provides an intuitive UI to manage Ollama model…☆82Oct 8, 2025Updated 11 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- convert pytorch model to ncnn☆13Dec 5, 2018Updated 7 years ago
- Rigs is an Agent orchestration framework based on Rig☆19Apr 4, 2025Updated last year
- A robust Python toolkit for converting video/audio content into accurate, multilingual subtitles using WhisperX for transcription and Goo…☆29Sep 16, 2026Updated last week
- A bytebot variant that uses Holo 1.5 7b to control the desktop☆25Nov 4, 2025Updated 10 months ago
- Mapping intelligence for enterprise data migrations: schema mapping, lineage, and transformation traceability that compounds across every…☆15May 7, 2026Updated 4 months ago
- The most advanced, lightweight, and undetectable C++ open-source utility client base for Minecraft. Built with ImGui and modular architec…☆25Mar 21, 2026Updated 6 months ago
- How to replace DOMParser in a webworker environment☆10Nov 16, 2019Updated 6 years ago
- An Open-Source Modular AI Assistant☆32Mar 20, 2025Updated last year
- Group-relative Trajectory-based Policy Optimization: Increasing Quality and Training Stability☆42Feb 23, 2026Updated 7 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A high-performance embedded vector database optimized for edge devices, delivering speed and efficiency with the advanced HNSW indexing a…☆11Jul 31, 2024Updated 2 years ago
- Ultra-lightweight C++ inference engine for BitMamba-2 (1.58-bit SSM). Runs 1B models on consumer CPUs at 50+ tok/s using <700MB RAM. No h…☆21Jun 2, 2026Updated 3 months ago
- Developing K - a language model to generate OPENSCAD code from prompt☆19Dec 3, 2025Updated 9 months ago
- this is a dungeon ai run locally that use your llm in the terminal with multiple players from 2 to 5☆17Jan 25, 2026Updated 8 months ago
- LLamaHTML is a simple html file to communicate with a running llamacpp llama-server☆25Aug 5, 2025Updated last year
- A local-first web search agent☆30Jun 20, 2026Updated 3 months ago
- Desktop app with Compose Multiplatform to use Qwen3-TTS with an UI.☆77Aug 2, 2026Updated last month