An educational Rust project for exporting and running inference on Qwen3 LLM family
☆44Aug 3, 2025Updated last year
Alternatives and similar repositories for qwen3-rs
Users that are interested in qwen3-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inspect LLM's logprobs and perplexity over a piece of text, or compare two LLMs (like a git diff)☆18Aug 3, 2026Updated last month
- Multi-agent orchestration framework for AI applications - build, deploy, and manage AI agents across the full lifecycle with Forge, Conve…☆33Mar 28, 2026Updated 5 months ago
- A miniaturized version of the Kimi-K2 model optimized for deployment on single H100 GPUs.☆36Jul 16, 2025Updated last year
- Zero-instrumentation LLM API and MCP tracer for your agents powered by eBPF — latency, tokens, and tool use in realtime☆18Mar 16, 2026Updated 5 months ago
- ☆18Dec 1, 2025Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆23Apr 3, 2026Updated 5 months ago
- ☆42Jul 13, 2026Updated last month
- ☆16Feb 1, 2025Updated last year
- the centralized smart contract platform☆14Jan 5, 2025Updated last year
- A MCP stdio toolpack for local LLMs☆34Apr 6, 2026Updated 5 months ago
- Machine Bullshit: Characterizing the Emergent Disregard for Truth in Large Language Models☆27Sep 14, 2025Updated 11 months ago
- DocFinder is a local-first indexing and searching documents using semantic embeddings stored in SQLite. Everything runs on your machine, …☆29Updated this week
- A Prometheus metrics exporter for NVIDIA DGX Spark clusters.☆22Feb 16, 2026Updated 6 months ago
- ☆20Jan 3, 2026Updated 8 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Generate Duolingo-style quiz courses from PDFs with spaced repetition, adaptive difficulty, and tutor chat.☆16Apr 6, 2026Updated 5 months ago
- MiniLM (BERT) embeddings from scratch☆21Aug 14, 2025Updated last year
- A Chrome extension that enables virtual fashion try-on and model swap using FASHN AI. Hover over fashion images on any website to: (1) tr…☆22Aug 14, 2025Updated last year
- Load and run Llama from safetensors files in C☆16Oct 24, 2024Updated last year
- Protocol for Augmented Memory of Project Artifacts (MCP compatible) - extended☆24Jan 24, 2026Updated 7 months ago
- ☆24Jan 22, 2025Updated last year
- convert pytorch model to ncnn☆13Dec 5, 2018Updated 7 years ago
- A robust Python toolkit for converting video/audio content into accurate, multilingual subtitles using WhisperX for transcription and Goo…☆28Updated this week
- LLM inference in C/C++☆23Oct 4, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆31Sep 1, 2025Updated last year
- A bytebot variant that uses Holo 1.5 7b to control the desktop☆25Nov 4, 2025Updated 10 months ago
- Mapping intelligence for enterprise data migrations: schema mapping, lineage, and transformation traceability that compounds across every…☆15May 7, 2026Updated 4 months ago
- 📋 Table component for WASM frameworks.☆22Mar 2, 2026Updated 6 months ago
- Convert strings to any case☆11Jan 24, 2024Updated 2 years ago
- An Open-Source Modular AI Assistant☆32Mar 20, 2025Updated last year
- Make Qwen3 Think like Gemini 2.5 Pro | Open webui function☆25May 10, 2025Updated last year
- Ultra-lightweight C++ inference engine for BitMamba-2 (1.58-bit SSM). Runs 1B models on consumer CPUs at 50+ tok/s using <700MB RAM. No h…☆20Jun 2, 2026Updated 3 months ago
- this is a dungeon ai run locally that use your llm in the terminal with multiple players from 2 to 5☆17Jan 25, 2026Updated 7 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- LLamaHTML is a simple html file to communicate with a running llamacpp llama-server☆25Aug 5, 2025Updated last year
- A local-first web search agent☆30Jun 20, 2026Updated 2 months ago
- A sandboxed local task runner for Rust☆22Sep 20, 2024Updated last year
- Desktop app with Compose Multiplatform to use Qwen3-TTS with an UI.☆74Aug 2, 2026Updated last month
- Node utility to inline images, CSS and JavaScript for a web page - useful for mobile sites☆16Mar 17, 2020Updated 6 years ago
- ☆12Jun 30, 2022Updated 4 years ago
- Fulloch - The Fully Local Home Voice Assistant☆135Updated this week