shell-nlp / gpt_server
gpt_server是一个用于生产级部署LLMs或Embedding的开源框架。
☆158Updated this week
Alternatives and similar repositories for gpt_server:
Users that are interested in gpt_server are comparing it to the libraries listed below
- 添加🚀流式 Web 服务到 GraphRAG,兼容 OpenAI SDK,支持可访问的实体链接🔗,支持建议问题,兼容本地嵌入模型,修复诸多问题。Add streaming web server to GraphRAG, compatible with OpenAI SD…☆240Updated 2 months ago
- dify's rag patch module☆172Updated last month
- Agentica: Effortlessly Build Intelligent, Reflective, and Collaborative Multimodal AI Agents! 轻松构建智能、具备反思能力、可协作的多模态AI Agent。☆138Updated this week
- GraphRAG的应用实例,项目特点在于提供了替换OpenAI模型的方法,并通过修改原有提示和切分文档的方法,提高了GraphRAG处理中文内容的能力。☆125Updated 4 months ago
- ☆210Updated 2 months ago
- 360LayoutAnaylsis, a series Document Analysis Models and Datasets deleveped by 360 AI Research Institute☆267Updated 6 months ago
- 基于大语言模型的检索增强生成RAG示例☆130Updated 3 months ago
- 如需体验textin文档解析,请点击https://cc.co/16YSIy☆76Updated 4 months ago
- 部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ,实现了OpenAI中Chat, Models和Completions接口,包含流式响…☆90Updated last year
- ☆63Updated 5 months ago
- A LLM RAG system runs on your laptop. 大模型检索增强生成系统,可以轻松部署在笔记本电脑上,实现本地知识库智能问答。☆189Updated last month
- ☆59Updated 4 months ago
- 中文原生检索增强生成测评基准☆111Updated 10 months ago
- LightRAG与GraphRAG在索引构建、检索测试中的耗时、模型请求次数、Token消耗金额、检索质量等方面进行对比☆58Updated 3 months ago
- 利用免费的大模型api来结合你的私域数据来生成sft训练数据(妥妥白嫖)支持llamafactory等工具的训练数据格式synthetic data☆150Updated 3 months ago
- 支持中文🇨🇳🇨🇳🇨🇳 的 microsoft/graphrag☆38Updated last month
- Analysis of Chinese and English layouts 中英文版面分析☆177Updated 2 weeks ago
- Easy-to-Use RAG Framework; CCF AIOps International Challenge 2024 Top3 Solution; CCF AIOps 国际挑战赛 2024 季军方案☆355Updated 3 months ago
- An easy-to-use framework for modular RAG☆336Updated this week
- 一个适合学习、使用、自主扩展的RAG【检索增强生成】系统!可联网做AI搜索☆459Updated 6 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆132Updated 3 months ago
- 本项目是针对RAG中的Retrieve阶段的召回技术及算法效果所做评估实验。使用主体框架为LlamaIndex.☆223Updated 2 months ago
- Alpaca Chinese Dataset -- 中文指令微调数据集☆193Updated 5 months ago
- 企业级RAG系统从入门到精通☆364Updated this week
- AI 应用示例合集☆86Updated 9 months ago
- Imitate OpenAI with Local Models☆87Updated 6 months ago
- ChatGPT WebUI using gradio. 给 LLM 对话和检索知识问答RAG提供一个简单好用的Web UI界面☆117Updated 6 months ago
- 基于 Langchain,快速集成GLM-4 AllTools 功能的插件☆45Updated 7 months ago
- 探索 LLM 在法律行业的应用潜力☆82Updated 3 months ago
- Q&A based on elasticsearch+langchain+chatglm2 | 基于elasticsearch,langchain,chatglm2的自有知识库问答☆235Updated last year