Description: Experimental nano-vLLM fork for Qwen3.6 support, CUDA Graph, paged KV cache, and inference-engine learning.
☆20Oct 15, 2026Updated 2 weeks ago
Alternatives and similar repositories for nano-vllm-qwen3.6
Users that are interested in nano-vllm-qwen3.6 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 开箱即用的轻量级推理引擎，全面超越nano-vllm；支持Qwen3系列模型 ；流式调用与openai兼容接口/ A lightweight LLM inference engine built from scratch☆18Sep 10, 2026Updated last month
- TinyWebServer一百小时☆13Mar 30, 2024Updated 2 years ago
- ☆13Jun 11, 2026Updated 4 months ago
- NEO SDK written in Java☆12Oct 23, 2018Updated 8 years ago
- OpenCode-based time-series harness for structured forecasting, contextual reasoning, tool use, and validation-driven agent workflows.☆14Oct 13, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Nature Cancer 2026: PRET: A Few-shot System for Pan-cancer Recognition Without Example Training☆17May 12, 2026Updated 5 months ago
- Materials for "Multi-property Steering of Large Language Models with Dynamic Activation Composition"☆14Nov 22, 2024Updated last year
- Desk Mate, a microservices-based Help Desk Software powered by MERN stack and Tailwind CSS, streamlines support with a robust ticketing s…☆11Aug 10, 2024Updated 2 years ago
- Finance planner app to track and calculate finance info from expenses, banking, investments, savings, insurance and get advice from AI fe…☆15Aug 21, 2026Updated 2 months ago
- This is the original matlab version of MKCFup☆10Jan 23, 2019Updated 7 years ago
- Cab booking system using Object Oriented design in Java☆12Jun 21, 2020Updated 6 years ago
- This repository is inspired by nano-vllm. Thanks! The core improvements include a CUDA-based Add+RMSNorm fused kernel, Chunked Prefill fo…☆36Updated this week
- ☆16Jul 30, 2026Updated 3 months ago
- 深度学习pdf☆16Aug 10, 2017Updated 9 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Light-weight, fast, fixed capacity key/value storage engine base on bitcask storage model☆30Aug 25, 2025Updated last year
- ☆14Mar 26, 2025Updated last year
- 构建一个医疗领域知识图谱和一个基于Flask的简易网页聊天机器人，通过ner获取用户问题的实体并在知识图谱内提取答案。☆11Apr 25, 2023Updated 3 years ago
- A general training alignment framework for LLM training debugging. OSDI ’26 Best Paper Nominee.☆16Oct 20, 2026Updated last week
- ☆10Aug 4, 2019Updated 7 years ago
- ☆20Jun 16, 2026Updated 4 months ago
- 逐段引导技术简历写作、事实核验、岗位定位与最终 PDF 制作的 Codex Skill☆28Jul 18, 2026Updated 3 months ago
- ATOD: Annealed Turn-Aware On-Policy Distillation for Multi-Turn Agentic Tasks☆21Sep 11, 2026Updated last month
- ☆13Sep 28, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- 仿小红书项目☆22May 10, 2025Updated last year
- COSA: Context-aware Output-Space Adapter for Test-Time Adaptation in Time Series Forecasting (ICLR 2026)☆24Aug 13, 2026Updated 2 months ago
- Made a CPU in Logisim when I was 14 (2009), and wrote a naive assembler and compiler for it in Flash. The CPU's design is inspired by Don…☆10Sep 30, 2016Updated 10 years ago
- ☆10Feb 4, 2021Updated 5 years ago
- ☆19Apr 21, 2026Updated 6 months ago
- Radix Tree KV Cache with Turn-Aware Growth☆12Jul 21, 2025Updated last year
- afac2026赛道四baseline☆22Jun 9, 2026Updated 4 months ago
- Educational implementation of Kimi Delta Attention from 'Kimi Linear: An Expressive, Efficient Attention Architecture' (arXiv:2510.26692)☆16Updated this week
- Position-independent caching for hybrid-attention LLM serving.☆20Jul 27, 2026Updated 3 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Very small and high performance CPU☆13Dec 3, 2024Updated last year
- A Tour booking Website with Stripe integration, email notifications, JWT cookies authorization, and it's built with technologies like Exp…☆11Sep 11, 2024Updated 2 years ago
- [ECCV 2026] MeGAS: Thermomechanical Dynamic Gaussian Splatting for Thermophysical Scene Editing☆17Oct 8, 2026Updated 3 weeks ago
- AI Hedge Fund Repo integrate with DeepSeek V3 and R1 hosted on SiliconFlow.☆14Feb 3, 2025Updated last year
- [TMLR 26]: "UniRec: Unified Multimodal Encoding for LLM-Based Recommendations", Zijie Lei, Tao Feng, Zhigang Hua, Yan Xie, Guanyu Lin, Sh…☆15Jul 9, 2026Updated 3 months ago
- Dataset accompanying AI Rules? Characterizing Reddit Community Policies Towards AI-Generated Content☆16Apr 29, 2025Updated last year
- Minimal uart for small iCE40 Lattice FPGAs. 8N1. 32 or 34 logicCells☆10Jul 20, 2017Updated 9 years ago