gameofdimension / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
☆9Updated 10 months ago
Related projects: ⓘ
- Large-scale exact string matching tool☆15Updated 11 months ago
- A prompt set of ChatGLM-6B☆14Updated last year
- A more efficient GLM implementation!☆54Updated last year
- Yuren 13B is an information synthesis large language model that has been continuously trained based on Llama 2 13B, which builds upon the…☆14Updated 11 months ago
- rwkv finetuning☆35Updated 4 months ago
- 问题生成器,无限追问☆11Updated last year
- ☆23Updated this week
- Tracking the hot Github repos and update daily 每天自动追踪Github热门项目☆39Updated this week
- GPT+神器,简单实用的一站式AGI架构,内置本地化,LLM模型,agent,矢量数据库,智能链chain☆47Updated last year
- Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory☆24Updated 4 months ago
- zero零训练llm调参☆30Updated last year
- qwen2 and llama3 cpp implementation☆34Updated 3 months ago
- 千问14B和7B的逐行解释☆46Updated 11 months ago
- GRAIN: Gradient-based Intra-attention Pruning on Pre-trained Language Models☆17Updated last year
- 纯c++的全平台llm加速库,支持python调用,支持baichuan, glm, llama, moss基座,手机端流畅运行chatglm-6B级模型单卡可达10000+token / s,☆44Updated last year
- 演示 vllm 对中文大语言模型的神奇效果☆31Updated 10 months ago
- ☆12Updated last year
- share data, prompt data , pretraining data☆35Updated 9 months ago
- Its an open source LLM based on MOE Structure.☆56Updated 2 months ago
- 实现Blip2RWKV+QFormer的多模态图文对话大模型,使用Two-Step Cognitive Psychology Prompt方法,仅3B参数的模型便能够出现类人因果思维链。对标MiniGPT-4,ImageBind等图文对话大语言模型,力求以更小的算力和资源实…☆36Updated last year
- MOSS 003 WebSearchTool: A simple but reliable implementation☆45Updated last year
- The paddle implementation of meta's LLaMA.☆44Updated last year
- A light proxy solution for HuggingFace hub.☆43Updated 10 months ago
- ChatYuan-7B☆13Updated last year
- XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.☆35Updated 4 months ago
- 首个llama2 13b 中文版模型 (Base + 中文对话SFT,实现流畅多轮人机自然语言交互)☆89Updated last year
- aigc evals☆10Updated 9 months ago
- accelerate generating vector by using onnx model☆10Updated 7 months ago
- 集成了LLM与SDXL的AIGC应用程序☆25Updated 8 months ago