Alternatives and similar repositories for vllm-cn

Users that are interested in vllm-cn are comparing it to the libraries listed below

• mindspore-lab / mindformers
  ☆169Updated this week
• SmartFlowAI / LLM101n-CN
  LLM101n: Let's build a Storyteller 中文版
  ☆131Updated 10 months ago
• open-chinese / alpaca-chinese-dataset
  Alpaca Chinese Dataset -- 中文指令微调数据集
  ☆208Updated 9 months ago
• liguodongiot / unify-easy-llm
  unify-easy-llm（ULM）旨在打造一个简易的一键式大模型训练工具，支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。
  ☆55Updated 11 months ago
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆259Updated last month
• Glanvery / LLM-Travel
  欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。
  ☆328Updated 11 months ago
• mobvoi / seq-monkey-data
  ☆148Updated last year
• KMnO4-zx / TinyRAG
  TinyRAG
  ☆314Updated 2 weeks ago
• Chinese-Tiny-LLM / Chinese-Tiny-LLM
  ☆230Updated last year
• pandada8 / llm-inference-benchmark
  LLM 推理服务性能测试
  ☆42Updated last year
• infinigence / InfiniWebSearch
  A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.
  ☆38Updated 6 months ago
• FlagOpen / FlagData
  ☆343Updated last year
• datawhalechina / llm-deploy
  大模型/LLM推理和部署理论与实践
  ☆291Updated 4 months ago
• ArtificialZeng / Baichuan2-Explained
  Baichuan2代码的逐行解析版本，适合小白
  ☆214Updated last year
• yongzhuo / LLM-SFT
  中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微…
  ☆205Updated last year
• OpenBMB / MiniCPM-CookBook
  This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…
  ☆253Updated last week
• jiangnanboy / llm_corpus_quality
  大模型预训练中文语料清洗及质量评估 Large model pre-training corpus cleaning
  ☆67Updated 11 months ago
• chenweiphd / DeepSeek-MoE-ResourceMap
  ☆133Updated 4 months ago
• xinyuwei-david / david-share
  ☆312Updated this week
• SmartFlowAI / Hand-on-RAG
  顾名思义：手搓的RAG
  ☆125Updated last year
• alipay / PainlessInferenceAcceleration
  Accelerate inference without tears
  ☆319Updated 3 months ago
• mindspore-lab / mindpet
  ☆45Updated last year
• shell-nlp / gpt_server
  gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。
  ☆199Updated this week
• sunkx109 / llama
  Inference code for LLaMA models
  ☆121Updated last year
• QwenLM / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆136Updated 7 months ago
• zhanshijinwat / Steel-LLM
  Train a 1B LLM with 1T tokens from scratch by personal
  ☆692Updated 2 months ago
• owenliang / qwen-vllm
  通义千问VLLM推理部署DEMO
  ☆587Updated last year
• AI-Study-Han / Zero-Chatgpt
  从0开始，将chatgpt的技术路线跑一遍。
  ☆243Updated 10 months ago
• datawhalechina / unlock-deepseek
  DeepSeek 系列工作解读、扩展和复现。
  ☆661Updated 3 months ago
• llm-factory / LLaMA-Factory-Doc
  LLaMA Factory Document
  ☆140Updated last month