zhangnengwei123 / vLLM-docker-Qwen2Links
学习vLLM,使用vLLM部署Qwen2-0.5B的模型,并使用docker部署。
☆18Updated last year
Alternatives and similar repositories for vLLM-docker-Qwen2
Users that are interested in vLLM-docker-Qwen2 are comparing it to the libraries listed below
Sorting:
- 利用免费的大模型api来结合你的私域数据来生成sft训练数据(妥妥白嫖)支持llamafactory等工具的训练数据格式synthetic data☆188Updated last year
- The Level-Navi Agent, a framework that requires no training and utilizes large language models for deep query understanding and precise s…☆81Updated 11 months ago
- 基于Qwen2模型进行通用信息抽取【实体/关系/事件抽取】☆38Updated last year
- 基于Roo Cline+DeepSeek的AI开发教程☆73Updated 8 months ago
- A Python Package to Access World-Class Generative Models☆129Updated last year
- LLama3中文个人版本☆40Updated last year
- ☆31Updated 2 months ago
- 视频理解:千问视频多模态模型 & Dify☆65Updated last year
- ☆113Updated last year
- python package to parse pdfs with different parsers☆209Updated 2 months ago
- gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。☆235Updated this week
- 医疗问诊系统multi-agent框架☆89Updated 8 months ago
- 基于Gradio开发的ChatGPT聊天应用,可以文字 或 语音对话,发送的音频通过OpenAI的STT转文本后,再通过ChatGPT生成回复,回复的内容通过OpenAI TTS合成后返回并自动播放,实现语音聊天功能。☆35Updated last year
- Python3 package for Chinese/English OCR,use paddleocr-v5 onnx model(~20MB), with ultra-fast inference speed. 基于ppocr-v5-onnx模型推理,中英文OCR开源…☆116Updated 4 months ago
- support BM25+vecetor☆29Updated 6 months ago
- Tracking the hot Github repos and update daily 每天自动追踪Github热门项目☆49Updated this week
- 筱可的工程实验仓库!☆99Updated last month
- An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.☆29Updated last year
- YiZhao: A 2TB Open Financial Corpus. Data and tools for generating and inspecting YiZhao, a safe, high-quality, open-source bilingual fin…☆34Updated 4 months ago
- 首个llama2 13b 中文版模型 (Base + 中文对话SFT,实现流畅多轮人机自然语言交互)☆91Updated 2 years ago
- ✨🦋 illufly - 【幻蝶】基于记忆蒸馏、资料检索的自我进化智能体☆74Updated last week
- 如需体验textin文档解析,请点击https://cc.co/16YSIy☆22Updated last year
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆34Updated 9 months ago
- bisheng-unstructured library☆56Updated 6 months ago
- SPO | Self-Supervised Prompt Optimization☆29Updated 8 months ago
- GenAI Playground☆23Updated last year
- 想要从零开始训练一个中文的mini大语言模型,可以进行基本的对话,模型大小根据手头的机器决定☆64Updated last year
- Agentica: Effortlessly Build Intelligent, Reflective, and Collaborative Multimodal AI Agents! 构建智能的多模态AI Agent。☆218Updated last month
- 📝 针对文档类图像做内容提取,将文档类图像一比一输出到Word或者Txt中,便于进一步使用或处理。后续计划支持输入PDF/图像,输出对应json格式、Txt格式、Word格式和Markdown格式。☆206Updated last year
- Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory☆29Updated last year