shell-nlp / gpt_server
gpt_server是一个用于生产级部署LLMs或Embedding的开源框架。
☆151Updated this week
Alternatives and similar repositories for gpt_server:
Users that are interested in gpt_server are comparing it to the libraries listed below
- dify's rag patch module☆113Updated 3 weeks ago
- 添加🚀流式 Web 服务到 GraphRAG,兼容 OpenAI SDK,支持可访问的实体链接🔗,支持建议问题,兼容本地嵌入模型,修复诸多问题。Add streaming web server to GraphRAG, compatible with OpenAI SD…☆232Updated last month
- ☆183Updated last month
- 基于大语言模型的检索增强生成RAG示例☆118Updated 2 months ago
- Agentica: Effortlessly Build Intelligent, Reflective, and Collaborative Multimodal AI Agents! 轻松构建智能、具备反思能力、可协作的多模态AI Agent。☆126Updated last month
- GraphRAG的应用实例,项目特点在于提供了替换OpenAI模型的方法,并通过修改原有提示和切分文档的方法,提高了GraphRAG处理中文内容的能力。☆106Updated 3 months ago
- 部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ,实现了OpenAI中Chat, Models和Completions接口,包含流式响…☆89Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆128Updated 2 months ago
- 本项目是针对RAG中的Retrieve阶段的召回技术及算法效果所做评估实验。使用主体框架为LlamaIndex.☆203Updated last month
- A collection of RAG systems powered by LLM.☆155Updated 3 months ago
- Alpaca Chinese Dataset -- 中文指令微调数据集【人工+GPT4o持续更新】☆193Updated 4 months ago
- 中文原生检索增强生成测评基准☆108Updated 9 months ago
- 一个适合学习、使用、自主扩展的RAG【检索增强生成】系统!可联网做AI搜索☆437Updated 5 months ago
- ChatGPT WebUI using gradio. 给 LLM 对话和检索知识问答RAG提供一个简单好用的Web UI界面☆110Updated 5 months ago
- 360LayoutAnaylsis, a series Document Analysis Models and Datasets deleveped by 360 AI Research Institute☆261Updated 5 months ago
- An easy-to-use framework for modular RAG☆316Updated this week
- 雅意信息抽取大模型:在百万级人工构造的高质量信息抽取数据上进行指令微调,由中科闻歌算法团队研发。 (Repo for YAYI Unified Information Extraction Model)☆287Updated 6 months ago
- Imitate OpenAI with Local Models☆85Updated 5 months ago
- ☆59Updated 3 months ago
- bge推理优化相关脚本☆27Updated last year
- RAG-QA-Generator 是一个用于检索增强生成(RAG)系统的自动化知识库构建与管理工具。该工具通过读取文档数据,利用大规模语言模型生成高质量的问答对(QA对),并将这些数据插入数据库中,实现RAG系统知识库的自动化构建和管理。☆96Updated last month
- chatglm-6B for tools application using langchain☆75Updated last year
- Implement OpenAI APIs and plugin-enabled ChatGPT with open source LLM and other models.☆120Updated 7 months ago
- Easy-to-Use RAG Framework; CCF AIOps International Challenge 2024 Top3 Solution; CCF AIOps 国际挑战赛 2024 季军方案☆293Updated 2 months ago
- 大模型检索增强生成技术最佳实践。☆58Updated 5 months ago
- CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models☆269Updated 3 months ago
- 企业级RAG系统从入门到精通☆308Updated 3 weeks ago
- langchain学习笔记,包含langchain源码解读、langchain中使用中文模型、langchain实例等。☆189Updated last year
- ☆296Updated 8 months ago
- A LLM RAG system runs on your laptop. 大模型检索增强生成系统,可以轻松部署在笔记本电脑上,实现本地知识库智能问答。☆147Updated this week