注释的nano_vllm仓库，并且完成了MiniCPM4的适配以及注册新模型的功能
☆172Aug 11, 2025Updated 7 months ago
Alternatives and similar repositories for nano_vllm_note
Users that are interested in nano_vllm_note are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- some hpc project for learning☆26Aug 28, 2024Updated last year
- ☆20Updated this week
- Persistent dense gemm for Hopper in `CuTeDSL`☆15Aug 9, 2025Updated 7 months ago
- ☆13Jan 7, 2025Updated last year
- Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"☆11Oct 11, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- FlashTile is a CUDA Tile IR compiler that is compatible with NVIDIA's tileiras, targeting SM70 through SM121 NVIDIA GPUs.☆58Feb 6, 2026Updated last month
- Implementation and optimization of matrix multiplication on single CPU (HPC-THU-2023-Autumn)☆18Feb 27, 2024Updated 2 years ago
- A light llama-like llm inference framework based on the triton kernel.☆178Jan 5, 2026Updated 2 months ago
- ☆20Aug 20, 2025Updated 7 months ago
- Nano vLLM☆13Jun 26, 2025Updated 9 months ago
- An onnx-based quantitation tool.☆71Jan 8, 2024Updated 2 years ago
- Implement Flash Attention using Cute.☆103Dec 17, 2024Updated last year
- ToyLLM: Learning LLM from Scratch☆25Updated this week
- A GPU FP32 computation method with Tensor Cores.☆26Dec 8, 2025Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Optimize softmax in triton in many cases☆23Sep 6, 2024Updated last year
- 跟着Tensorrt_pro学习各种知识☆39Nov 25, 2022Updated 3 years ago
- 算子库☆17Jul 9, 2025Updated 8 months ago
- 本仓库在OpenVINO推理框架下部署Nanodet检测算法，并重写预处理和后处理部分，具有超高性能！让你在Intel CPU平台上的检测速度起飞！ 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度，推理速度更快！☆16Jun 14, 2023Updated 2 years ago
- Matrix multiplication on GPUs for matrices stored on a CPU. Similar to cublasXt, but ported to both NVIDIA and AMD GPUs.☆32Apr 2, 2025Updated 11 months ago
- ☆32Jul 2, 2025Updated 8 months ago
- 晚上下班不刷手机，学点什么。系列一：CUDA 计算框架 CUFX (Cuda Framework eXtended)。☆16Dec 15, 2024Updated last year
- AiTer Optimized Model☆49Mar 23, 2026Updated last week
- 基于天池新闻推荐赛数据集实现的新闻推荐☆46Dec 17, 2024Updated last year
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- a base36 extension for postgres☆18Mar 14, 2025Updated last year
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding☆96Dec 2, 2025Updated 3 months ago
- Nano vLLM☆12,487Nov 3, 2025Updated 4 months ago
- A Triton-only attention backend for vLLM☆24Mar 17, 2026Updated last week
- ☆42Apr 9, 2024Updated last year
- ☆94May 31, 2025Updated 9 months ago
- HPC Game Platform☆11Apr 20, 2023Updated 2 years ago
- ☆119May 16, 2025Updated 10 months ago
- 智能计算系统陈云霁、数值计算王兵团笔记☆10Oct 14, 2022Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Minimalist vLLM implementation in Rust☆148Mar 21, 2026Updated last week
- 在使用AI工具进行深入分析面试岗位需求与应聘者简历的基础上，依据既定标准向应聘 者提出针对性问题。在应聘者完成问题解答后，将对简历内容及面试表现进行全面评估，并提供具体的改进建 议，以助其提升职业竞争力。☆17Mar 19, 2024Updated 2 years ago
- flash attention 优化日志☆27Jun 4, 2025Updated 9 months ago
- jump to a place when progam runs to the max instruction number☆15Dec 14, 2023Updated 2 years ago
- ☆16Jan 14, 2025Updated last year
- ☆11Jun 9, 2023Updated 2 years ago
- FlagTree is a unified compiler supporting multiple AI chip backends for custom Deep Learning operations, which is forked from triton-lang…☆227Mar 23, 2026Updated last week