wangshuai09 / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆38Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- ☆172Updated this week
- Imitate OpenAI with Local Models☆89Updated last year
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆95Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆137Updated 8 months ago
- 本项目旨在对大量文本文件进行快速编码检测和转换以辅助mnbvc语料集项目的数据清洗工作☆62Updated 10 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆264Updated 3 weeks ago
- Mixture-of-Experts (MoE) Language Model☆189Updated 11 months ago
- 大语言模型指令调优工具(支持 FlashAttention)☆179Updated last year
- ☆30Updated last year
- 欢迎来到 "LLM-travel" 仓库!探索大语言模型(LLM)的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆338Updated last year
- ☆84Updated last year
- A MoE impl for PyTorch, [ATC'23] SmartMoE☆67Updated 2 years ago
- qwen models finetuning☆103Updated 5 months ago
- 怎么训练一个LLM分词器☆152Updated 2 years ago
- ☆113Updated 9 months ago
- unify-easy-llm(ULM)旨在打造一个简易的一键式大模型训练工具,支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。☆57Updated last year
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆42Updated last year
- 中文原生检索增强生成测评基准☆122Updated last year
- 使用单个24G显卡,从0开始训练LLM☆55Updated last month
- ☆231Updated last year
- [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.☆248Updated 10 months ago
- Alpaca Chinese Dataset -- 中文指令微调数据集☆213Updated 10 months ago
- 大模型预训练中文语料清洗及质量评估 Large model pre-training corpus cleaning☆69Updated last year
- ☆157Updated last year
- ☆176Updated last year
- Official Repository for SIGIR2024 Demo Paper "An Integrated Data Processing Framework for Pretraining Foundation Models"☆82Updated last year
- Model Compression for Big Models☆164Updated 2 years ago
- Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).☆247Updated last year
- Qwen1.5-SFT(阿里, Ali), Qwen_Qwen1.5-2B-Chat/Qwen_Qwen1.5-7B-Chat微调(transformers)/LORA(peft)/推理☆67Updated last year
- 部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ,实现了OpenAI中Chat, Models和Completions接口,包含流式响…☆95Updated last year