vLLM Documentation in Chinese Simplified / vLLM 中文文档
☆194Mar 5, 2026Updated 5 months ago
Alternatives and similar repositories for vllm-cn
Users that are interested in vllm-cn are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Triton Documentation in Chinese Simplified / Triton 中文文档☆120Mar 5, 2026Updated 5 months ago
- ☆22Nov 6, 2025Updated 9 months ago
- ☆29Mar 30, 2026Updated 5 months ago
- A collection of state-of-the-art Super-Resolution/Person re-identification architectures.☆18Nov 9, 2020Updated 5 years ago
- This repository contains the code for 4th place solution for approach to RecSys Challenge 2020.☆18Sep 26, 2020Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A high-throughput and memory-efficient inference and serving engine for LLMs☆90,602Updated this week
- [ACL 2023] Are Pre-trained Language Models Useful for Model Ensemble in Chinese Grammatical Error Correction?☆10Dec 15, 2025Updated 8 months ago
- 🌿 DeepPrune: Parallel Scaling without Inter-trace Redundancy☆21Apr 20, 2026Updated 4 months ago
- 分析银行营销活动数据以预测客户有多大可能购买存款产品☆13Feb 10, 2020Updated 6 years ago
- Accelerating GOT-OCRv2 with VLLM☆10Nov 15, 2024Updated last year
- Official implementation for "Knowledge Distillation with Refined Logits".☆24Aug 26, 2024Updated 2 years ago
- Multi-Level Triton Runner supporting Python, IR, PTX, AMDGCN, cubin and hasco.☆99May 8, 2026Updated 3 months ago
- The JavaScript SDK for CozeLoop 🧭☆20Apr 22, 2026Updated 4 months ago
- A large-scale RWKV v7(World, PRWKV, Hybrid-RWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy…☆52Oct 21, 2025Updated 10 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.☆3,340Updated this week
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆34Feb 10, 2025Updated last year
- Optimizing diffusion for production-ready speeds☆40Jan 10, 2026Updated 7 months ago
- xllamacpp - a Python wrapper of llama.cpp☆86Updated this week
- ☆15Jan 30, 2026Updated 7 months ago
- 2024CCF国际AIOps挑战赛-赛道二（GLM4）：基于检索增强的运维知识问答挑战赛解决方案分享。☆14Jul 5, 2024Updated 2 years ago
- 中文金融大模型测评基准，六大类二十五任务、等级化评价，国内模型获得A级☆10May 6, 2024Updated 2 years ago
- ☆435Sep 18, 2025Updated 11 months ago
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 本仓库基于 Intel OpenVINO Toolkit 部署 LightTrack 跟踪算法，包含 Python、C++ 两种语言的推理代码.☆21Nov 2, 2023Updated 2 years ago
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆6,446Updated this week
- wePoker is a multi-player poker game for Android☆12Mar 20, 2013Updated 13 years ago
- 2024届求职-C++后端-学习笔记-操作系统、计算机网络、C++语言+算法☆13Oct 31, 2023Updated 2 years ago
- ☆14Oct 11, 2023Updated 2 years ago
- [ICLR 2024] Inducing High Energy-Latency of Large Vision-Language Models with Verbose Images☆43Jan 25, 2024Updated 2 years ago
- Official Implementation of "Learning to Refuse: Towards Mitigating Privacy Risks in LLMs"☆10Dec 13, 2024Updated last year
- Python 业务开发常见错误案例集 配套源代码☆10Dec 19, 2020Updated 5 years ago
- ☆17Jan 1, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline mod…☆677Sep 11, 2024Updated last year
- ☆27Aug 6, 2026Updated 3 weeks ago
- 本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）☆24,986Jul 19, 2026Updated last month
- Partial Codes and datasets for NeurIPS'19 "Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers"☆20Nov 1, 2019Updated 6 years ago
- Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM☆3,745Updated this week
- Materials for learning SGLang☆882Jan 5, 2026Updated 7 months ago
- Nano vLLM☆15,246Apr 26, 2026Updated 4 months ago