vLLM Documentation in Chinese Simplified / vLLM 中文文档
☆189Mar 5, 2026Updated 4 months ago
Alternatives and similar repositories for vllm-cn
Users that are interested in vllm-cn are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A tiny, didactical implementation of LLAMA 3☆42Dec 2, 2024Updated last year
- ☆16Feb 22, 2025Updated last year
- Fast and memory-efficient exact attention☆21Updated this week
- Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 …☆40May 31, 2025Updated last year
- A collection of state-of-the-art Super-Resolution/Person re-identification architectures.☆18Nov 9, 2020Updated 5 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Companion code for Grokking Megakernels: fuse an entire LLM forward pass into a single CUDA kernel☆23Feb 9, 2026Updated 5 months ago
- This repository contains the code for 4th place solution for approach to RecSys Challenge 2020.☆18Sep 26, 2020Updated 5 years ago
- Android Demon of mobilev2-yolo5s and retinaface☆17Nov 14, 2020Updated 5 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆87,317Updated this week
- Swoft Postgresql Component☆10Nov 4, 2019Updated 6 years ago
- [ACL 2023] Are Pre-trained Language Models Useful for Model Ensemble in Chinese Grammatical Error Correction?☆10Dec 15, 2025Updated 7 months ago
- 🌿 DeepPrune: Parallel Scaling without Inter-trace Redundancy☆21Apr 20, 2026Updated 3 months ago
- SGLang is a high-performance serving framework for large language models and multimodal models.☆30,854Updated this week
- Accelerating GOT-OCRv2 with VLLM☆10Nov 15, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Multi-Level Triton Runner supporting Python, IR, PTX, AMDGCN, cubin and hasco.☆98May 8, 2026Updated 2 months ago
- FlashInfer: Kernel Library for LLM Serving☆6,053Updated this week
- The JavaScript SDK for CozeLoop 🧭☆20Apr 22, 2026Updated 3 months ago
- A large-scale RWKV v7(World, PRWKV, Hybrid-RWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy…☆51Oct 21, 2025Updated 9 months ago
- A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.☆3,159Updated this week
- Optimizing diffusion for production-ready speeds☆40Jan 10, 2026Updated 6 months ago
- ☆15Jan 30, 2026Updated 5 months ago
- 2024CCF国际AIOps挑战赛-赛道二（GLM4）：基于检索增强的运维知识问答挑战赛解决方案分享。☆14Jul 5, 2024Updated 2 years ago
- ☆435Sep 18, 2025Updated 10 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated 11 months ago
- 本仓库基于 Intel OpenVINO Toolkit 部署 LightTrack 跟踪算法，包含 Python、C++ 两种语言的推理代码.☆21Nov 2, 2023Updated 2 years ago
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆6,063Updated this week
- VQA-Med 2021☆24May 13, 2026Updated 2 months ago
- wePoker is a multi-player poker game for Android☆12Mar 20, 2013Updated 13 years ago
- yolov8seg 瑞芯微 rknn 板端 C++部署，使用平台 rk3588。☆31May 8, 2024Updated 2 years ago
- Courses in UCAS☆14Jun 12, 2023Updated 3 years ago
- ☆14Oct 11, 2023Updated 2 years ago
- Python 业务开发常见错误案例集 配套源代码☆10Dec 19, 2020Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆17Jan 1, 2025Updated last year
- Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline mod…☆665Sep 11, 2024Updated last year
- [CIKM 2025] LLMAEL: Large Language Models are Good Context Augmenters for Entity Linking☆17Sep 6, 2025Updated 10 months ago
- 本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）☆24,813Jul 19, 2026Updated last week
- Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM☆3,593Updated this week
- Materials for learning SGLang☆861Jan 5, 2026Updated 6 months ago
- Nano vLLM☆14,679Apr 26, 2026Updated 3 months ago