开箱即用的轻量级推理引擎，全面超越nano-vllm；支持Qwen3系列模型 ；流式调用与openai兼容接口/ A lightweight LLM inference engine built from scratch
☆18Sep 10, 2026Updated last month
Alternatives and similar repositories for Z-vllm
Users that are interested in Z-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TinyWebServer一百小时☆13Mar 30, 2024Updated 2 years ago
- This repository is inspired by nano-vllm. Thanks! The core improvements include a CUDA-based Add+RMSNorm fused kernel, Chunked Prefill fo…☆36Sep 12, 2026Updated last month
- A minimal open-source on-policy-distillation implementation☆11May 21, 2026Updated 5 months ago
- 仿小红书项目☆22May 10, 2025Updated last year
- OpenAPI based libraries for different programming languages like R and Python☆26Sep 23, 2026Updated last month
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- paddlepaddle框架 论文复现（CNN特征可视化）+VGG16猫脸分类（动态图）☆17Jul 29, 2020Updated 6 years ago
- Multimodal Analysis for Emotion Recognition☆10Nov 21, 2022Updated 3 years ago
- Conditional Neural Expert Processes☆11Mar 15, 2025Updated last year
- ☆17Jul 16, 2020Updated 6 years ago
- Recent papers and projects in multitask learning and their applications☆10Jul 20, 2026Updated 3 months ago
- A lightweight key-value storage engine based on the Bitcask model.☆40Mar 2, 2025Updated last year
- A Bitcask (LSM+WAL) Key/Value Store written in Go.☆35Mar 12, 2019Updated 7 years ago
- Reimplementation the paper of Recurrent Convolutional Network for Video-based Person Re-Identification in Pytorch☆10Apr 9, 2019Updated 7 years ago
- ☆15Sep 20, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A project to train your model from scratch or fine-tune a pretrained model using the losses provided in this library to improve out-of-di…☆18Nov 26, 2022Updated 3 years ago
- 一个使用 cpp 语言开发的基于 bitcask 模型，兼容 Redis 数据结构的学习级别 KV 存储引擎。☆36Jun 29, 2024Updated 2 years ago
- The training process for Credit and Risk Assessment Large Language Model (CALM)☆10Oct 15, 2023Updated 3 years ago
- Reverse Engineering of the Mythos Architecture — What I Think☆24May 15, 2026Updated 5 months ago
- A cross-modal vector index with fast construction on heterogeneous CPU-GPU environment. Published on DaMoN@SIGMOD 2025.☆16Jul 16, 2025Updated last year
- ☆15Aug 4, 2020Updated 6 years ago
- Code for our paper "Active Perception using Light Curtains for Autonomous Driving", ECCV 2020☆10Dec 7, 2021Updated 4 years ago
- TensorRT-in-Action 是一个 GitHub 代码库，提供了使用 TensorRT 的代码示例，并有对应 Jupyter Notebook。☆15Jun 1, 2023Updated 3 years ago
- Gaussian Process Regression for Python/Numpy☆14Jun 4, 2016Updated 10 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆17Nov 8, 2024Updated last year
- RocksDB/LevelDB inspired key-value database in Go☆10Nov 3, 2020Updated 5 years ago
- Rust implementation of Google protocol buffers☆12Oct 20, 2025Updated last year
- A compact, readable PyTorch reference implementation of the DeepSeek-V4 architecture (Flash and Pro), in the spirit of nanoGPT. ~4,300 LO…☆20Aug 14, 2026Updated 2 months ago
- corpus and code for joint modeling of dialogue acts and sentiments in social media☆16Jan 13, 2020Updated 6 years ago
- code for Region Proposal by Guided Anchoring☆13May 17, 2019Updated 7 years ago
- [NeurIPS 2024] PediatricsGPT: Large Language Models as Chinese Medical Assistants for Pediatric Applications☆23Nov 4, 2024Updated last year
- Official code for our COLING 2022 paper: In-Context Learning for Empathetic Dialogue Generation☆20Mar 1, 2023Updated 3 years ago
- ☆18Jun 9, 2026Updated 4 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A multi-language code evaluation tool.☆28Jan 26, 2024Updated 2 years ago
- LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.☆38Jun 23, 2024Updated 2 years ago
- Tools for physical measurement of video frame presentation timing☆17Feb 4, 2024Updated 2 years ago
- Tutorial for rCore OS step by step (3rd edition)☆10Apr 24, 2021Updated 5 years ago
- 乱序摸鱼：面向 LinxISA NPU 大型系统开发的多 Agent harness 原型☆22Jul 16, 2026Updated 3 months ago
- [cvpr2026] UniPR: Unified Object-level Real-to-Sim Perception and Reconstruction from a Single Stereo Pair☆18Mar 27, 2026Updated 6 months ago
- Mxnet2Caffe_Tensor RT☆18Apr 20, 2019Updated 7 years ago