zhangnengwei123 / vLLM-docker-Qwen2Links
学习vLLM,使用vLLM部署Qwen2-0.5B的模型,并使用docker部署。
☆18Updated 11 months ago
Alternatives and similar repositories for vLLM-docker-Qwen2
Users that are interested in vLLM-docker-Qwen2 are comparing it to the libraries listed below
Sorting:
- LLama3中文个人版本☆39Updated last year
- 欢迎来到“筱可AI研习社”的实战项目仓库!这个仓库主要用于存储和展示为公众号撰写的各类实战项目。我们会不断优化和迭代这些项目,以探索AI的无限可能。☆43Updated this week
- TPO 是一个优化 LLM 输出文本的框架,通过迭代反馈和优化提示的方式来“微调模型”,而非直接调整模型的参数,使模型在推理过程中与人类偏好对齐以生成更好的结果。本项目提供了一个友好的 WebUI 来加载模型,实时优化基础模型并展示最佳结果。☆10Updated 3 months ago
- 如需体验textin文档解析,请点击https://cc.co/16YSIy☆22Updated 10 months ago
- 基于Qwen2模型进行通用信息抽取【实体/关系/事件抽取】☆31Updated 10 months ago
- 本项目致力于为大模型领域的初学者提供全面的知识体系,包括基础和高阶内容,以便开发者能迅速掌握大模型技术栈并全面了解相关知识。☆59Updated 4 months ago
- 基于 Dify + Langfuse 的自动化评估服务☆63Updated last week
- A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.☆38Updated 5 months ago
- The Level-Navi Agent, a framework that requires no training and utilizes large language models for deep query understanding and precise s…☆79Updated 5 months ago
- support BM25+vecetor☆29Updated last week
- Qwen GRPO Graph Extraction RL Finetune☆49Updated 2 months ago
- ☆112Updated 9 months ago
- ✨🦋 illufly - 【幻蝶】基于记忆蒸馏、资料检索的自我进化智能体☆64Updated 2 weeks ago
- optimize your prompt like promptperfect|万能提示词|大语言模型提示词优化☆41Updated last year
- bisheng-unstructured library☆48Updated 2 weeks ago
- Using APPL to reimplement popular algorithms for Large Language Models (LLMs) and prompts☆44Updated 4 months ago
- 大语言模型训练和服务调研☆37Updated last year
- ☆41Updated 2 months ago
- In this fast-paced world, we all need a little something to spice up life. Whether you need a glass of sweet talk to lift your spirits or…☆58Updated this week
- 通过paddle ocr实现pdf转markdown☆69Updated 7 months ago
- Tracking the hot Github repos and update daily 每天自动追踪Github热门项目☆49Updated this week
- Agentica: Effortlessly Build Intelligent, Reflective, and Collaborative Multimodal AI Agents! 轻松构建智能、具备反思能力、可协作的多模态AI Agent。☆168Updated this week
- A book room based Agent | 智能书库☆52Updated last month
- 大型语言模型实战指南:应用实践与场景落地☆71Updated 8 months ago
- 基于ReAct手搓一个Agent Demo☆136Updated 3 weeks ago
- 利用免费的大模型api来结合你的私域数据来生成sft训练数据(妥妥白嫖)支持llamafactory等工具的训练数据格式synthetic data☆164Updated 6 months ago
- 首个llama2 13b 中文版模型 (Base + 中文对话SFT,实现流畅多轮人机自然语言交互)☆90Updated last year
- 视频理解:千问视频多模态模型 & Dify☆58Updated 9 months ago
- Countdown Game Distill&RL☆47Updated last month
- A unified tool to generate fine-tuning datasets for LLMs, including questions, answers, and dialogues. ✨🤖📚💬☆58Updated 2 months ago