A Mini-vLLM optimization project for Qwen3-32B TP=2 serving, Prefix Cache, and Triton PagedAttention.
☆102Aug 6, 2026Updated 2 months ago
Alternatives and similar repositories for mini-vllm-qwen3-serving
Users that are interested in mini-vllm-qwen3-serving are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆979Jul 22, 2026Updated 2 months ago
- CLI runbook for agent long run.☆1,416Sep 2, 2026Updated last month
- All-in-One Multimodal Parsing Engine + Ontology-Powered, LLM Wiki-Driven AI-Ready Knowledge Engine☆1,406Oct 10, 2026Updated last week
- ☆646Sep 28, 2026Updated 3 weeks ago
- Official repository for the ACM MM 2026 Oral paper “Remember-R1: Mitigating Long-Context Visual Forgetting through Reinforcement Learning…☆419Aug 28, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Build AI agents grounded in a creator's documents, audio, and video.☆932Sep 1, 2026Updated last month
- Community desktop companion for DeepSeek Harness — one-click Electron app for macOS and Windows☆705Sep 13, 2026Updated last month
- Verify that the PowerPoint you are about to deliver is exactly the PPTX that passed QA—locally, offline, and with tamper-evident evidence…☆880Aug 25, 2026Updated last month
- Self-hosted AI trading terminal for Hyperliquid: chart read in, validated Freqtrade/Nautilus-Trader strategy out, deployed live.☆820Oct 9, 2026Updated last week
- Evidence-grounded, lightweight guardrails for strong coding agents—Fact, Plan, Execute, Review, and Handoff.☆62Aug 19, 2026Updated last month
- Verifiable handwriting synthesis for failure-driven multimodal training and regression.☆293Aug 27, 2026Updated last month
- ☆158Updated this week
- Autonomous LLM Trading Asterism — a research-only multi-agent trading platform with evidence-first research, an auditable console, Shadow…☆1,088Oct 7, 2026Updated last week
- semantic agent kernel which make agent efficient and self-evolve☆818Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Audit AI chat exports locally before sharing or migration. Find possible secrets, personal-data patterns, broken JSON/JSONL, SQLite issue…☆874Aug 25, 2026Updated last month
- Windows 笔记导出与迁移工具：七平台适配、四格式导出、离线阅读，明确验证范围与失败状态。☆1,005Sep 9, 2026Updated last month
- Track, visualize, and compete on your AI coding-assistant token usage — CLI + web leaderboard & teamboard.☆770Updated this week
- Graybox camera previs tool driven by natural-language shot descriptions.☆239Aug 11, 2026Updated 2 months ago
- ☆992Jul 16, 2026Updated 3 months ago
- Agent Skills for Solopreneurs & Teams.☆552Updated this week
- Agnes Harness: A pluggable agent harness for Forward Deployed Engineering (FDE). Built for trust. Made for the real world.☆777Updated this week
- [Official Repo] JoyAI-Video-Edit: Real-Time Open-Ended Video Editing with Autoregressive Diffusion☆1,956Updated this week
- Real-world AI penetration testing engineer for authorized assessments — built-in cloud module covering AWS/Azure/GCP + Aliyun/Tencent/Hua…☆953Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Mimir — 一站式科研工作台插件：LaTeX 论文边写边编译、arXiv 文献管理、实验追踪、指标图表、GPU 服务器 SSH 任务编排，管理科研全周期。An open-source research workbench plugin for the whole res…☆543Updated this week
- Reconcile stuck AI-agent tasks after restarts and timeouts. Preview SQLite changes, close stale delivery states, and never guess success.☆910Aug 25, 2026Updated last month
- 🎬 Generate images from any camera viewpoint via 3D interactive control. Drag the camera in 3D space or use sliders to set azimuth/elevat…☆1,011Aug 28, 2026Updated last month
- Intent-driven AI coding workflow runtime for consistent context, skills, approvals, validation, and handoffs across six AI coding hosts.☆439Updated this week
- ☆317Sep 28, 2026Updated 2 weeks ago
- ☆578Updated this week
- Histology Spatial Topology for Omics Profiling and Inter-section Alignment☆777Updated this week
- Delete one complete turn from a DeepSeek Harness session without deleting the session☆108Aug 18, 2026Updated 2 months ago
- ☆691Aug 25, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Boring Is All You Need: a Codex Desktop workflow replacement with transactional migration, audit-only managed hooks, risk-based review, s…☆169Aug 10, 2026Updated 2 months ago
- Ship a 2-3 min product vision video in a weekend — using only AI tools. No filming, no editing suite, no design chops needed. PASTOR fram…☆246Aug 23, 2026Updated last month
- SEO foundation checks as an Agent Skill: give it a URL, get a crawler's-eye pass/fail report with evidence. 26 structural checks, zero LL…☆785Sep 1, 2026Updated last month
- An auto-evolution framework that optimizes anything — your 7×24 team of algorithm engineers.☆1,222Updated this week
- A lightweight Sichuan digital twin operation dashboard with Canvas map rendering, realtime simulation and bilingual documentation.☆203Jun 25, 2026Updated 3 months ago
- Local-first, AI-centered, evidence-gated job application workflow☆199Sep 6, 2026Updated last month
- ☆498Updated this week