shell-nlp / gpt_serverLinks
gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。
☆197Updated last week
Alternatives and similar repositories for gpt_server
Users that are interested in gpt_server are comparing it to the libraries listed below
Sorting:
- Alpaca Chinese Dataset -- 中文指令微调数据集☆208Updated 9 months ago
- Agentica: Effortlessly Build Intelligent, Reflective, and Collaborative Multimodal AI Agents! 构建智能的多模态AI Agent。☆179Updated this week
- ☆252Updated 6 months ago
- 部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ,实现了OpenAI中Chat, Models和Completions接口,包含流式响…☆94Updated last year
- 探索 LLM 在法律行业的应用潜力☆90Updated 7 months ago
- An easy-to-use framework for modular RAG☆374Updated this week
- 添加🚀流式 Web 服务到 GraphRAG,兼容 OpenAI SDK,支持可访问的实体链接🔗,支持建议问题,兼容本地嵌入模型,修复诸多问题。Add streaming web server to GraphRAG, compatible with OpenAI SD…☆255Updated 3 months ago
- 基于大语言模型的检索增强生成RAG示例☆152Updated 2 months ago
- 利用免费的大模型api来结合你的私域数据来生成sft训练数据(妥妥白嫖)支持llamafactory等工具的训练数据格式synthetic data☆169Updated 7 months ago
- 如需体验textin文档解析,请点击https://cc.co/16YSIy☆106Updated last week
- 中文原生检索增强生成测评基准☆119Updated last year
- dify's rag patch module☆253Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆136Updated 7 months ago
- GraphRAG的应用实例,项目特点在于提供了替换OpenAI模型的方法,并通过修改原有提示和切分文档的方法,提高了GraphRAG处理中文内容的能力。☆165Updated 8 months ago
- 360LayoutAnaylsis, a series Document Analysis Models and Datasets deleveped by 360 AI Research Institute☆291Updated 10 months ago
- ☆343Updated last year
- Q&A based on elasticsearch+langchain+chatglm2 | 基于elasticsearch,langchain,chatglm2的自有知识库问答☆242Updated last year
- ☆128Updated 4 months ago
- 本项目是针对RAG中的Retrieve阶段的召回技术及算法效果所做评估实验。使用主体框架为LlamaIndex.☆262Updated 6 months ago
- Convert files into markdown to help RAG or LLM understand, based on markitdown and MinerU, which could provide high quality pdf parser.☆118Updated 3 months ago
- QA based on local knowledge and LLM.☆231Updated 5 months ago
- [ACL2025 demo track] ROGRAG: A Robustly Optimized GraphRAG Framework☆160Updated last week
- ChatGPT WebUI using gradio. 给 LLM 对话和检索知识问答RAG提供一个简单好用的Web UI界面☆130Updated 10 months ago
- 通义千问VLLM推理部署DEMO☆587Updated last year
- 中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微…☆205Updated last year
- 一个适合学习、使用、自主扩展的RAG【检索增强 生成】系统!可联网做AI搜索☆496Updated 10 months ago
- Implement OpenAI APIs and plugin-enabled ChatGPT with open source LLM and other models.☆120Updated last year
- Analysis of Chinese and English layouts 中英文版面分析☆222Updated this week
- A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.☆38Updated 6 months ago
- ChatPilot: Chat Agent Web UI,实现Chat对话前端,支持Google搜索、文件网址对话(RAG)、代码解释器功能,复现了Kimi Chat(文件,拖进来;网址,发出来)。☆573Updated 2 weeks ago