Nano vLLM
☆26Aug 11, 2025Updated last year
Alternatives and similar repositories for nano-vllm
Users that are interested in nano-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A single-file educational implementation for understanding vLLM's core concepts and running LLM inference.☆45Apr 7, 2026Updated 4 months ago
- A from-scratch Prefill/Decode disaggregation inference engine for LLMs☆163May 10, 2026Updated 3 months ago
- 基于Rust的大模型推理框架☆12Aug 9, 2026Updated 3 weeks ago
- Source code of IPA, https://escholarship.org/uc/item/2p0805dq☆13Jun 27, 2024Updated 2 years ago
- Multi-party Private Set Intersections & Threshold Set Intersections☆14Apr 2, 2021Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆163Mar 5, 2026Updated 5 months ago
- ☆13Jun 25, 2022Updated 4 years ago
- 基于RK3588的边缘预警项目（C++）。 采用Yolov7算法，通过读取输入视频源（RTSP、USB摄像头等），经过自创轻量级目标跟踪算法去重检测，将告警信息实时通过HTTP接口推送，同时将视频源进行转发并利用RTMP协议推送。☆17Apr 28, 2024Updated 2 years ago
- ☆11Mar 21, 2023Updated 3 years ago
- Advanced Programming - HW5☆22May 10, 2022Updated 4 years ago
- This repository organizes materials, recordings, and schedules related to AI-infra learning meetings.☆577Mar 1, 2026Updated 5 months ago
- PyTorch code for our paper "AdaSVD: Adaptive Singular Value Decomposition for Large Language Models"☆15Mar 9, 2025Updated last year
- Draft-Target Disaggregation LLM Serving System via Parallel Speculative Decoding.☆216Mar 18, 2026Updated 5 months ago
- Triton based sparse quantization attention kernel collection☆43Aug 29, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- INSPIRE: Intensity and Spatial Information-Based Deformable Image Registration☆12Jun 30, 2021Updated 5 years ago
- YOLOv5 series model supports the latest TensorRT10.☆16Jul 24, 2024Updated 2 years ago
- Conditional Latent Coding (CLC) for Deep Image Compression☆15Feb 6, 2026Updated 6 months ago
- This repository is the summary of all of our works for the XLA.☆11Jan 14, 2018Updated 8 years ago
- Pix2Pix and CycleGAN generative adversarial networks (GANs) to convert thermal to visible images using TensorFlow☆10Jan 20, 2022Updated 4 years ago
- ☆107Sep 9, 2024Updated last year
- Simple intermediate representation language for learning and research.☆22Mar 27, 2020Updated 6 years ago
- 通过onnxruntime实现yolov8在CPU和GPU上面部署☆27Aug 17, 2024Updated 2 years ago
- ☆85Feb 5, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 个人学习编译原理、理解创造一个编译器主体流程的小项目☆10Oct 7, 2020Updated 5 years ago
- Using acl and c/c++ writing coroutine,http/https,server,json,redis,mysql,network,nio,etc,.☆20Oct 8, 2025Updated 10 months ago
- 注释的nano_vllm仓库，并且完成了MiniCPM4的适配以及注册新模型的功能☆206Aug 11, 2025Updated last year
- A case study of quantitative modeling for beginners.☆26Jan 26, 2026Updated 7 months ago
- ☆33Jun 22, 2024Updated 2 years ago
- A C++ Implementation of "RIFT: Multi-Modal Image Matching Based on Radiation-Variation Insensitive Feature Transform".☆15Apr 15, 2022Updated 4 years ago
- 🍎 One kernel a day keeps high latency away. A hands-on CUDA learning path featuring a rich collection of kernels, from the basics to pea…☆212Updated this week
- ☆30Nov 3, 2022Updated 3 years ago
- A simple demonstration of how PyTorch autograd works☆16Sep 23, 2021Updated 4 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Advanced Programming - HW4☆16Apr 23, 2022Updated 4 years ago
- Based on Nano-vLLM, a simple replication of vLLM with self-contained paged attention and flash attention implementation☆1,003Updated this week
- ☆15Apr 15, 2022Updated 4 years ago
- nano-vllm是开源的一个gpu推理项目，基于开源版本弄的一个ascend npu版本推理小demo，旨在帮助初学者了解推理的整体流程，区别于vllm，nano-vllm体量更小，麻雀虽小五脏俱全，更有助于初学者学习。☆131May 4, 2026Updated 3 months ago
- Convert ONNX models to plain C++ code (without dependencies)☆22Mar 27, 2023Updated 3 years ago
- Private set intersection using garbled bloom filters in semi-honest setting☆26Dec 11, 2015Updated 10 years ago
- ☆37May 7, 2026Updated 3 months ago