Alternatives and similar repositories for vllm

Users that are interested in vllm are comparing it to the libraries listed below

• llm-factory / imitater
  Imitate OpenAI with Local Models
  ☆88Updated last year
• hyperai / vllm-cn
  vLLM Documentation in Chinese Simplified / vLLM 中文文档
  ☆106Updated 3 weeks ago
• mindspore-lab / mindformers
  ☆174Updated this week
• QwenLM / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆137Updated 9 months ago
• genggui001 / Megatron-DeepSpeed-Llama
  ☆84Updated 2 years ago
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆58Updated last year
• yanqiangmiffy / how-to-train-tokenizer
  怎么训练一个LLM分词器
  ☆153Updated 2 years ago
• alanshi / charset_mnbvc
  本项目旨在对大量文本文件进行快速编码检测和转换以辅助mnbvc语料集项目的数据清洗工作
  ☆64Updated 2 weeks ago
• Glanvery / LLM-Travel
  欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。
  ☆340Updated last year
• IEIT-Yuan / Yuan2.0-M32
  Mixture-of-Experts (MoE) Language Model
  ☆190Updated last year
• Chinese-Tiny-LLM / Chinese-Tiny-LLM
  ☆232Updated last year
• OpenBMB / UltraEval
  [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.
  ☆248Updated 10 months ago
• zejunwang1 / LLMTuner
  大语言模型指令调优工具（支持 FlashAttention）
  ☆178Updated last year
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆264Updated last month
• LowinLi / transformers-stream-generator
  This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/…
  ☆97Updated last year
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆56Updated 10 months ago
• modelscope / easydistill
  a toolkit on knowledge distillation for large language models
  ☆162Updated last week
• CASIA-LM / ChineseWebText
  ☆175Updated last year
• OpenSenseNova / piccolo-embedding
  code for piccolo embedding model from SenseTime
  ☆140Updated last year
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆98Updated last year
• SomeoneKong / llm_long_context_bench202405
  ☆29Updated last year
• xubuvd / LLMs
  专注于中文领域大语言模型，落地到某个行业某个领域，成为一个行业大模型、公司级别或行业级别领域大模型。
  ☆122Updated 6 months ago
• llm-factory / LLaMA-Factory-Doc
  LLaMA Factory Document
  ☆150Updated 2 weeks ago
• percent4 / llm_math_solver
  本项目用于大模型数学解题能力方面的数据集合成，模型训练及评测，相关文章记录。
  ☆95Updated last year
• CLUEbenchmark / SuperCLUE-RAG
  中文原生检索增强生成测评基准
  ☆122Updated last year
• beichao1314 / Open-Llama
  The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.
  ☆67Updated 2 years ago
• OpenBMB / BMCook
  Model Compression for Big Models
  ☆165Updated 2 years ago
• zhangzhao219 / WSDM-Cup-2024
  1st Solution For Conversational Multi-Doc QA Workshop & International Challenge @ WSDM'24 - Xiaohongshu.Inc
  ☆161Updated 2 months ago
• open-chinese / alpaca-chinese-dataset
  Alpaca Chinese Dataset -- 中文指令微调数据集
  ☆214Updated 11 months ago
• infinigence / InfiniWebSearch
  A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.
  ☆39Updated 9 months ago