An educational Rust project for exporting and running inference on Qwen3 LLM family
☆44Aug 3, 2025Updated 11 months ago
Alternatives and similar repositories for qwen3-rs
Users that are interested in qwen3-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inspect LLM's logprobs and perplexity over a piece of text, or compare two LLMs (like a git diff)☆20Mar 23, 2026Updated 4 months ago
- Multi-agent orchestration framework for AI applications - build, deploy, and manage AI agents across the full lifecycle with Forge, Conve…☆33Mar 28, 2026Updated 4 months ago
- A miniaturized version of the Kimi-K2 model optimized for deployment on single H100 GPUs.☆35Jul 16, 2025Updated last year
- Zero-instrumentation LLM API and MCP tracer for your agents powered by eBPF — latency, tokens, and tool use in realtime☆18Mar 16, 2026Updated 4 months ago
- ☆18Dec 1, 2025Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Aphrodite running and saving data locally in the browser☆24Oct 8, 2022Updated 3 years ago
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆22Apr 3, 2026Updated 3 months ago
- 3.34× faster inference on Apple Silicon — native MLX port of DFlash speculative decoding☆19Apr 11, 2026Updated 3 months ago
- ☆37Jul 13, 2026Updated 2 weeks ago
- ☆16Feb 1, 2025Updated last year
- A MCP stdio toolpack for local LLMs☆33Apr 6, 2026Updated 3 months ago
- DocFinder is a local-first indexing and searching documents using semantic embeddings stored in SQLite. Everything runs on your machine, …☆26Updated this week
- A Prometheus metrics exporter for NVIDIA DGX Spark clusters.☆19Feb 16, 2026Updated 5 months ago
- Generate Duolingo-style quiz courses from PDFs with spaced repetition, adaptive difficulty, and tutor chat.☆16Apr 6, 2026Updated 3 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- MiniLM (BERT) embeddings from scratch☆21Aug 14, 2025Updated 11 months ago
- LLM training & inference in python/C++ with web UI☆37Jul 22, 2026Updated last week
- ☆20Jul 4, 2025Updated last year
- Load and run Llama from safetensors files in C☆15Oct 24, 2024Updated last year
- Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.☆184Jul 5, 2025Updated last year
- Protocol for Augmented Memory of Project Artifacts (MCP compatible) - extended☆24Jan 24, 2026Updated 6 months ago
- A sleek web interface for Ollama, making local LLM management and usage simple. WebOllama provides an intuitive UI to manage Ollama model…☆81Oct 8, 2025Updated 9 months ago
- convert pytorch model to ncnn☆13Dec 5, 2018Updated 7 years ago
- Rigs is an Agent orchestration framework based on Rig☆16Apr 4, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A robust Python toolkit for converting video/audio content into accurate, multilingual subtitles using WhisperX for transcription and Goo…☆28Dec 2, 2025Updated 7 months ago
- LLM inference in C/C++☆23Oct 4, 2024Updated last year
- Mapping intelligence for enterprise data migrations: schema mapping, lineage, and transformation traceability that compounds across every…☆17May 7, 2026Updated 2 months ago
- How to replace DOMParser in a webworker environment☆10Nov 16, 2019Updated 6 years ago
- The most advanced, lightweight, and undetectable C++ open-source utility client base for Minecraft. Built with ImGui and modular architec…☆26Mar 21, 2026Updated 4 months ago
- Group-relative Trajectory-based Policy Optimization: Increasing Quality and Training Stability☆42Feb 23, 2026Updated 5 months ago
- Make Qwen3 Think like Gemini 2.5 Pro | Open webui function☆25May 10, 2025Updated last year
- Ultra-lightweight C++ inference engine for BitMamba-2 (1.58-bit SSM). Runs 1B models on consumer CPUs at 50+ tok/s using <700MB RAM. No h…☆21Jun 2, 2026Updated last month
- Developing K - a language model to generate OPENSCAD code from prompt☆19Dec 3, 2025Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- this is a dungeon ai run locally that use your llm in the terminal with multiple players from 2 to 5☆17Jan 25, 2026Updated 6 months ago
- A local-first web search agent☆29Jun 20, 2026Updated last month
- Desktop app with Compose Multiplatform to use Qwen3-TTS with an UI.☆71Updated this week
- Reads and parses Linux device tree images☆17Feb 10, 2024Updated 2 years ago
- ergonomic columnar storage encoding crate☆29Sep 23, 2025Updated 10 months ago
- Agentic BYOK Browser-Based Website Builder☆51Jul 20, 2026Updated last week
- An embedded operating system built on seL4 in the Rust language.☆17Jan 28, 2016Updated 10 years ago