注释的nano_vllm仓库，并且完成了MiniCPM4的适配以及注册新模型的功能
☆192Aug 11, 2025Updated 10 months ago
Alternatives and similar repositories for nano_vllm_note
Users that are interested in nano_vllm_note are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 该仓库主要记录 大模型（LLMs） 算法工程师相关的面试题与我写的答案☆27Oct 14, 2023Updated 2 years ago
- This project aims to provide a high effective KV cache manage framework for llm inference and improve memory utilization and inference sp…☆61Apr 24, 2026Updated last month
- ☆13Jan 7, 2025Updated last year
- ☆36Updated this week
- FlashTile is a CUDA Tile IR compiler that is compatible with NVIDIA's tileiras, targeting SM70 through SM121 NVIDIA GPUs.☆61Feb 6, 2026Updated 4 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Implementation and optimization of matrix multiplication on single CPU (HPC-THU-2023-Autumn)☆18Feb 27, 2024Updated 2 years ago
- A highly efficient library for GEMM operations on Sunway TaihuLight☆18Sep 7, 2020Updated 5 years ago
- A light llama-like llm inference framework based on the triton kernel.☆188Jan 5, 2026Updated 5 months ago
- EasyNN是一个面向教学而开发的神经网络推理 框架，旨在让大家0基础也能自主完成推理框架编写！☆40Aug 26, 2024Updated last year
- ☆23Aug 20, 2025Updated 9 months ago
- Nano vLLM☆13Jun 26, 2025Updated 11 months ago
- 毕业设计: 基于深度学习的视觉问答☆14Jun 20, 2018Updated 7 years ago
- ☆254Jun 9, 2026Updated last week
- An onnx-based quantitation tool.☆71Jan 8, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ToyLLM: Learning LLM from Scratch☆25Jun 8, 2026Updated last week
- A GPU FP32 computation method with Tensor Cores.☆27Dec 8, 2025Updated 6 months ago
- Implement Flash Attention using Cute.☆108Dec 17, 2024Updated last year
- Optimize softmax in triton in many cases☆24Sep 6, 2024Updated last year
- 跟着Tensorrt_pro学习各种知识☆39Nov 25, 2022Updated 3 years ago
- 本仓库在OpenVINO推理框架下部署Nanodet检测算法，并重写预处理和后处理部分，具有超高性能！让你在Intel CPU平台上的检测速度起飞！ 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度，推理速度更快！☆16Jun 14, 2023Updated 3 years ago
- ☆32Jul 2, 2025Updated 11 months ago
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆4,402May 17, 2026Updated last month
- 基于天池新闻推荐赛数据集实现的新闻推荐☆51Dec 17, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A Triton-only attention backend for vLLM☆26Mar 17, 2026Updated 3 months ago
- My submission for the GPUMODE/AMD fp8 mm challenge☆29Jun 4, 2025Updated last year
- 基于C++/OpenCV的小猿口算自动图像识别+答题☆12Oct 11, 2024Updated last year
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding☆109Dec 2, 2025Updated 6 months ago
- A parser for PTX 6.5☆13Jun 19, 2023Updated 2 years ago
- ☆45Apr 9, 2024Updated 2 years ago
- ☆108May 31, 2025Updated last year
- study of cutlass☆22Nov 10, 2024Updated last year
- HPC Game Platform☆11Apr 20, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆122May 16, 2025Updated last year
- flash attention 优化日志☆31Jun 4, 2025Updated last year
- ☆49Apr 15, 2024Updated 2 years ago
- jump to a place when progam runs to the max instruction number☆16Dec 14, 2023Updated 2 years ago
- 📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉☆11,245May 29, 2026Updated 3 weeks ago
- ☆16Jan 14, 2025Updated last year
- ☆11May 2, 2023Updated 3 years ago