vLLM Documentation in Chinese Simplified / vLLM 中文文档
☆196Mar 5, 2026Updated 7 months ago
Alternatives and similar repositories for vllm-cn
Users that are interested in vllm-cn are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Triton Documentation in Chinese Simplified / Triton 中文文档☆127Mar 5, 2026Updated 7 months ago
- ☆19Mar 29, 2026Updated 6 months ago
- ☆29Mar 30, 2026Updated 6 months ago
- Fast and memory-efficient exact attention☆22Sep 10, 2026Updated last month
- Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 …☆40May 31, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆13May 28, 2025Updated last year
- A collection of state-of-the-art Super-Resolution/Person re-identification architectures.☆18Nov 9, 2020Updated 5 years ago
- This repository contains the code for 4th place solution for approach to RecSys Challenge 2020.☆18Sep 26, 2020Updated 6 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆93,455Updated this week
- [ACL 2023] Are Pre-trained Language Models Useful for Model Ensemble in Chinese Grammatical Error Correction?☆10Dec 15, 2025Updated 9 months ago
- ☆17Jan 27, 2026Updated 8 months ago
- SGLang is a high-performance serving framework for large language models and multimodal models.☆36,925Updated this week
- Accelerating GOT-OCRv2 with VLLM☆10Nov 15, 2024Updated last year
- Official implementation for "Knowledge Distillation with Refined Logits".☆24Aug 26, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Multi-Level Triton Runner supporting Python, IR, PTX, AMDGCN, cubin and hasco.☆100Sep 17, 2026Updated 3 weeks ago
- A Minimalistic Auto-Diff Optimization Framework for Teaching and Understanding Pytorch☆28Updated this week
- A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.☆3,513Updated this week
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆34Feb 10, 2025Updated last year
- Optimizing diffusion for production-ready speeds☆41Jan 10, 2026Updated 9 months ago
- xllamacpp - a Python wrapper of llama.cpp☆87Sep 26, 2026Updated 2 weeks ago
- 2024CCF国际AIOps挑战赛-赛道二（GLM4）：基于检索增强的运维知识问答挑战赛解决方案分享。☆14Jul 5, 2024Updated 2 years ago
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated last year
- ☆14May 17, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 本仓库基于 Intel OpenVINO Toolkit 部署 LightTrack 跟踪算法，包含 Python、C++ 两种语言的推理代码.☆21Nov 2, 2023Updated 2 years ago
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆6,746Updated this week
- Synthetic data generation for evaluating LLM symbolic and logic reasoning☆23Aug 13, 2026Updated last month
- Knowledge graph-based retrieval augmeted generation demonstrator for EGC 2024☆15Jan 10, 2024Updated 2 years ago
- wePoker is a multi-player poker game for Android☆12Mar 20, 2013Updated 13 years ago
- Siamese neural networks for one-shot logo recognition☆19Mar 19, 2022Updated 4 years ago
- Courses in UCAS☆15Jun 12, 2023Updated 3 years ago
- Alpaca Chinese Dataset -- 中文指令微调数据集☆219Oct 6, 2024Updated 2 years ago
- ☆14Oct 11, 2023Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Official Implementation of "Learning to Refuse: Towards Mitigating Privacy Risks in LLMs"☆10Dec 13, 2024Updated last year
- Python 业务开发常见错误案例集 配套源代码☆10Dec 19, 2020Updated 5 years ago
- ☆17Jan 1, 2025Updated last year
- 中文文本主题提取，并根据主题，对预测文本进行分类☆12May 18, 2020Updated 6 years ago
- Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline mod…☆682Sep 11, 2024Updated 2 years ago
- ☆27Aug 6, 2026Updated 2 months ago
- Partial Codes and datasets for NeurIPS'19 "Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers"☆20Nov 1, 2019Updated 6 years ago