zhangnengwei123 / vLLM-docker-Qwen2
学习vLLM,使用vLLM部署Qwen2-0.5B的模型,并使用docker部署。
☆16Updated 9 months ago
Alternatives and similar repositories for vLLM-docker-Qwen2:
Users that are interested in vLLM-docker-Qwen2 are comparing it to the libraries listed below
- A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.☆37Updated 3 months ago
- Python3 package for Chinese/English OCR, with paddleocr-v4 onnx model(~14MB). 基于ppocr-v4-onnx模型推理,可实现 CPU 上毫秒级的 OCR 精准预测,通用场景中英文OCR达到开源SO…☆65Updated 2 months ago
- ☆26Updated 5 months ago
- ☆30Updated 3 weeks ago
- 如需体验textin文档解析,请点击https://cc.co/16YSIy☆22Updated 8 months ago
- 利用免费的大模型api来结合你的私域数据来生成sft训练数据(妥妥白嫖)支持llamafactory等工具的训练数据格式synthetic data☆154Updated 4 months ago
- 📝 针对文档类图像做内容提取,将文档类图像一比一输出到Word或者Txt中,便于进一步使用或处理。后续计划支持输入PDF/图像,输出对应json格式、Txt格式、Word格式和Markdown格式。☆188Updated 5 months ago
- In this fast-paced world, we all need a little something to spice up life. Whether you need a glass of sweet talk to lift your spirits or…☆50Updated 2 months ago
- A gradio webui for Andrewyng translation-agent☆29Updated 4 months ago
- 基于Qwen2模型进行通用信息抽取【实体/关系/事件抽取】☆30Updated 8 months ago
- Here is a demo for PDF parser (Including OCR, object detection tools)☆34Updated 5 months ago
- Agentica: Effortlessly Build Intelligent, Reflective, and Collaborative Multimodal AI Agents! 轻松构建智能、具备反思能力、可协作的多模态AI Agent。☆145Updated 3 weeks ago
- An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.☆27Updated 6 months ago
- Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory☆28Updated 10 months ago
- A unified tool to generate fine-tuning datasets for LLMs, including questions, answers, and dialogues. ✨🤖📚💬☆57Updated 2 weeks ago
- Dive into LLM Agents☆17Updated 10 months ago
- LLama3中文个人版本☆38Updated 11 months ago
- ☆13Updated last year
- ✨🦋 illufly 是自我进化的 Agent 框架: 基于自我进化,快速创造价值☆60Updated this week
- 基于大语言模型的检索增强生成RAG示例☆137Updated 3 months ago
- ☆137Updated 10 months ago
- 本项目致力于为大模型领域的初学者提供全面的知识体系,包括基础和高阶内容,以便开发者能迅速掌握大模型技术栈并全面了解相关知识。☆53Updated 2 months ago
- 视频理解:千问视频多模态模型 & Dify☆46Updated 7 months ago
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆35Updated last month
- (撰写ing..)本仓库偏教程性质,以「模型中文化」为一个典型的模型训练问题切入场景,指导读者上手学习LLM二次微调训练。☆32Updated 7 months ago
- 如需体验textin文档解析,请点击https://cc.co/16YSIy☆83Updated 4 months ago
- ChatGPT WebUI using gradio. 给 LLM 对话和检索知识问答RAG提供一个简单好用的Web UI界面☆122Updated 7 months ago
- Python implementation of AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, w…☆38Updated last week
- Analysis of Chinese and English layouts 中英文版面分析☆187Updated last week
- SenseVoice-python: A enterprise-grade open source multi-language asr system from funasr opensource with onnxruntime☆86Updated 6 months ago