Runs the Qwen3.8 27B LLM on a single CPU with >=8GB of RAM, delivering up to ~7.4 tok/s. Written in pure Rust: no BLAS, no framework, no GPU!
☆13Nov 16, 2026Updated this week
Alternatives and similar repositories for qwen_inference_in_rust
Users that are interested in qwen_inference_in_rust are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Real-time collaboration for Codex☆34Updated this week
- An O(N) CPU-first linear recurrence inference runtime — hand-written AVX2/AVX-512 kernels, multi-architecture support (SunnyNet / RWKV-7…☆18Oct 28, 2026Updated 3 weeks ago
- Community-maintained continuation version of the FakePlayer plugin☆50Updated this week
- Local-first astrophotography companion for Android☆18Nov 9, 2026Updated last week
- A local-first Windows desktop companion for tasks, weather, quick links, and personal routines.☆38Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- C++17 active-object/HSM event framework. One header set for RT-Thread, FreeRTOS, and Linux. Bounded (fixed-capacity, no heap), detectable…☆114Updated this week
- BioSeeki · A personal AI research workspace for life sciences. 产品介绍、下载、使用指南与反馈。☆21Oct 21, 2026Updated last month
- Unlock DeepSeek Harness plugin-native core capabilities, unifying Runtime, Provider, Plugin, Skill and MCP orchestration to build an exte…☆24Sep 16, 2026Updated 2 months ago
- 本地优先、可追溯的 AI 桌面记忆与计划工具☆12Oct 11, 2026Updated last month
- desktoppet|desktop-pet|Desktop Pet|DesktopPet|Desktoppet|Anniversary Tracker|Relationship Journal|Offline Reminder 一款集情绪陪伴、回忆记录与生活提醒于一体的安…☆27Updated this week
- golang native declarative GUI framework, for building cross-platform (now Windows, Linux, macOS desktop) with composable views, custom wi…☆104Updated this week
- 一个跑在 WorkBuddy 上的麦当劳 Agent Skill:把一顿饭点明白,把优惠用到位,把积分算清楚,把抽奖守规矩。用着不烧心☆118Oct 21, 2026Updated 3 weeks ago
- 一款专注于慢性病管理的AI平台,通过多Agent协作问答、干预效果仿真预测、认知评估与训练、亲情账号关怀等核心技术,为慢病患者提供专业、个性化的健康管理服务☆31Nov 5, 2026Updated 2 weeks ago
- An open-source local print agent that enables silent printing from web applications.一个开源本地打印代理,让 Web 应用实现稳定的静默打印。☆138Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 瞬选灵眸(FlashGaze)— AI 辅助本地图像评分 CLI☆57Updated this week
- genecode:分子生物学智能体|本地优先的序列编辑与 AI 工作台,支持特征注释、引物、酶切位点及自定义模型接入。☆17Sep 27, 2026Updated last month
- Modern C++17 header-only embedded infrastructure library (Linux / ARM-Linux/ RT-Thread)☆119Updated this week
- 喵星图是面向《无限暖暖》打造的专属轻量化专业桌面媒体管理工具。NyanMap is a dedicated, lightweight, professional desktop media management tool designed for Infinity Nikk…☆130Updated this week
- EdgeBoard FZ3B MobileCLIP PS-PL inference and semantic video search, with separate PS, PL and Windows HOST sources.☆18Oct 13, 2026Updated last month
- TCYM.UI 是一个跨平台 UI 框架,面向桌面端场景,内置基础组件、布局与样式系统,便于快速构建应用界面。 UI 架构 平台与窗口层:基于 SDL3 负责窗口创建、输入事件、显示信息与跨平台宿主能力。 渲染层:基于 SkiaSharp 负责文本、图形、…☆63Oct 30, 2026Updated 3 weeks ago
- We can't prevent what we can't predict☆19Oct 13, 2026Updated last month
- 🍔 请你喜欢的创作者吃份巨无霸☆149Oct 19, 2026Updated last month
- MAVLink mission planner for planning, training, simulation, and flight-log analysis.☆15Oct 13, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Time-shifting task delegation for DeepSeek Harness (dsh): plan tasks at leisure, they run unattended off-peak, come back to a report. Hum…☆182Updated this week
- Auditable AI finance department: enterprise tenants, double-entry GL, expenses, procurement/payables, bank reconciliation + personal ledg…☆104Updated this week
- 一款自研的servlet容器--灵童☆17Oct 11, 2026Updated last month
- Your AI wrote the code. You still have to explain it before it ships.☆127Oct 24, 2026Updated 3 weeks ago
- A local conversation app for Android that comes with 50 built-in chat characters and supports custom character imports. It imposes no pro…☆19Sep 19, 2026Updated 2 months ago
- 支持多账号的小红书矩阵管理 CLI 工具,本地优先,具备统一治理功能(包括速率限制、去重及责任追溯)。可作为skill使用——拆解目标并筛选素材,支持跨平台操作,发布可强制要求人工审核。适合多账号的小红书运营团队,评论表现良好。☆26Aug 8, 2026Updated 3 months ago
- A lightweight, composable Agent Runtime for building extensible AI agents.☆83Sep 8, 2026Updated 2 months ago
- Encrypted LAN file transfer / 加密局域网文件传输 — desktop, Android, headless☆78Oct 26, 2026Updated 3 weeks ago
- Engineering workflow plugin for DeepSeek Harness: task stages, verification records, commit checks, and skill and rule management.☆18Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 基于麦当劳官方 MCP 的总结 Skill,呈现今年消费次数、金额、断食记录,并提供下一次使用提醒与每日宜吃指数。☆26Nov 2, 2026Updated 2 weeks ago
- 基于 C++23 与 Agent 架构的 OneBot 智能聊天机器人,支持群聊智能回复、跨会话消息共享、长期记忆、好感度(可选)、自定义工具扩展、MCP 及 Web 管理后台☆57Nov 8, 2026Updated last week
- Go SDK for standardizing local agent execution across `codex`, `claude`, `cursor` and `codebuddy`.☆80Nov 4, 2026Updated 2 weeks ago
- C#写的微信hook,非常低门槛的微信hook,只用于学习交流的微信hook,此微信hook比你想象的还简单,Windows 桌面程序 Hook 技术分析与开发示例/微信hook/WechatHook/WeiXinHook。☆106Aug 18, 2026Updated 3 months ago
- 【已有收入Skill库记录】一款可供境外留学 / 中外合办 / 外文文献的AI工具包,含多档位Skill库和基于此的相关Prompt库,把外语学案精准翻译成中文并一键导出 HTML/Word/Markdown ,免费连接 WikiData API 做术语权威匹配与注译,支持…☆126Updated this week
- 一个高度可定制化的 AI 角色扮演与互动叙事平台。☆31Nov 11, 2026Updated last week
- LZ-Litchi(荔枝软件开发平台) 是一个基于 JDK 21、SpringBoot 3、Vue 3、VbenAdmin 构建的现代化企业级开发平台,采用前后端分离架构,内置 RBAC 权限管理、多租户、工作流、代码生成、国际化(i18n)、向量数据库以图搜图、系统监控、…☆205Oct 25, 2026Updated 3 weeks ago
Are these results useful?