An educational Rust project for exporting and running inference on Qwen3 LLM family
☆43Aug 3, 2025Updated last year
Alternatives and similar repositories for qwen3-rs
Users that are interested in qwen3-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inspect LLM's logprobs and perplexity over a piece of text, or compare two LLMs (like a git diff)☆18Aug 3, 2026Updated 2 months ago
- Multi-agent orchestration framework for AI applications - build, deploy, and manage AI agents across the full lifecycle with Forge, Conve…☆33Mar 28, 2026Updated 6 months ago
- ☆42Aug 2, 2025Updated last year
- A miniaturized version of the Kimi-K2 model optimized for deployment on single H100 GPUs.☆36Jul 16, 2025Updated last year
- Zero-instrumentation LLM API and MCP tracer for your agents powered by eBPF — latency, tokens, and tool use in realtime☆18Mar 16, 2026Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆18Dec 1, 2025Updated 10 months ago
- Lightweight API Specification for Intelligent Systems☆17Sep 8, 2026Updated last month
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆24Apr 3, 2026Updated 6 months ago
- ☆48Oct 5, 2026Updated last week
- Aphrodite running and saving data locally in the browser☆24Oct 8, 2022Updated 4 years ago
- 3.34× faster inference on Apple Silicon: native MLX port of DFlash speculative decoding☆19Oct 7, 2026Updated last week
- ☆43Jul 13, 2026Updated 3 months ago
- ☆16Feb 1, 2025Updated last year
- A sleek web interface for Ollama, making local LLM management and usage simple. WebOllama provides an intuitive UI to manage Ollama model…☆83Oct 8, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Examples of how Bare makes running Javascript everywhere easy.☆15Mar 31, 2025Updated last year
- Machine Bullshit: Characterizing the Emergent Disregard for Truth in Large Language Models☆26Sep 14, 2025Updated last year
- ☆20Jan 3, 2026Updated 9 months ago
- MiniLM (BERT) embeddings from scratch☆22Aug 14, 2025Updated last year
- A Prometheus metrics exporter for NVIDIA DGX Spark clusters.☆25Feb 16, 2026Updated 8 months ago
- Generate Duolingo-style quiz courses from PDFs with spaced repetition, adaptive difficulty, and tutor chat.☆20Apr 6, 2026Updated 6 months ago
- One-Click RAG Implementation, Simple and Portable☆30Sep 22, 2026Updated 3 weeks ago
- RUST 哔哩哔哩客户端☆18Jun 19, 2023Updated 3 years ago
- A Chrome extension that enables virtual fashion try-on and model swap using FASHN AI. Hover over fashion images on any website to: (1) tr…☆22Aug 14, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Load and run Llama from safetensors files in C☆16Oct 24, 2024Updated last year
- Run LLaMA inference on CPU, with Rust 🦀🚀🦙☆36Jan 5, 2025Updated last year
- ☆21Jul 4, 2025Updated last year
- Protocol for Augmented Memory of Project Artifacts (MCP compatible) - extended☆23Jan 24, 2026Updated 8 months ago
- ☆24Jan 22, 2025Updated last year
- convert pytorch model to ncnn☆13Dec 5, 2018Updated 7 years ago
- A robust Python toolkit for converting video/audio content into accurate, multilingual subtitles using WhisperX for transcription and Goo…☆29Sep 16, 2026Updated last month
- Model Context Protocol for Scala 3☆13Mar 10, 2026Updated 7 months ago
- Mapping intelligence for enterprise data migrations: schema mapping, lineage, and transformation traceability that compounds across every…☆15May 7, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A multi-agent CLI tool powered by Swarms-rs and Composio☆14Jun 21, 2026Updated 3 months ago
- An Open-Source Modular AI Assistant☆32Mar 20, 2025Updated last year
- Coding agent with cool features.☆19Aug 23, 2026Updated last month
- The most advanced, lightweight, and undetectable C++ open-source utility client base for Minecraft. Built with ImGui and modular architec…☆25Mar 21, 2026Updated 6 months ago
- Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.☆15Sep 6, 2026Updated last month
- Group-relative Trajectory-based Policy Optimization: Increasing Quality and Training Stability☆42Feb 23, 2026Updated 7 months ago
- win32 native frontend for llama-cli☆14Nov 2, 2024Updated last year