shell-nlp / gpt_serverLinks
gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。
☆205Updated last week
Alternatives and similar repositories for gpt_server
Users that are interested in gpt_server are comparing it to the libraries listed below
Sorting:
- Alpaca Chinese Dataset -- 中文指令微调数据集☆213Updated 10 months ago
- An easy-to-use framework for modular RAG☆384Updated this week
- Agentica: Effortlessly Build Intelligent, Reflective, and Collaborative Multimodal AI Agents! 构建智能的多模态AI Agent。☆200Updated last week
- 部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ,实现了OpenAI中Chat, Models和Completions接口,包含流式响…☆95Updated last year
- 探索 LLM 在法律行业的应用潜力☆91Updated 8 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆136Updated 8 months ago
- 360LayoutAnaylsis, a series Document Analysis Models and Datasets deleveped by 360 AI Research Institute☆295Updated 11 months ago
- ChatGPT WebUI using gradio. 给 LLM 对话和检索知识问答RAG提供一个简单好用的Web UI界面☆132Updated last year
- ☆262Updated 7 months ago
- dify's rag patch module☆267Updated 2 weeks ago
- 中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微…☆208Updated last year
- ☆351Updated last year
- Q&A based on elasticsearch+langchain+chatglm2 | 基于elasticsearch,langchain,chatglm2的自有知识库问答☆242Updated last year
- [ACL2025 demo track] ROGRAG: A Robustly Optimized GraphRAG Framework☆172Updated this week
- 中文原生检索增强生成测评基准☆121Updated last year
- 如需体验textin文档解析,请点击https://cc.co/16YSIy☆117Updated last month
- 大模型预训练中文语料清洗及质量评估 Large model pre-training corpus cleaning☆69Updated last year
- 基于大语言模型的检索增强 生成RAG示例☆154Updated 3 months ago
- Implement OpenAI APIs and plugin-enabled ChatGPT with open source LLM and other models.☆121Updated last year
- 利用免费的大模型api来结合你的私域数据来生成sft训练数据(妥妥白嫖)支持llamafactory等工具的训练数据格式synthetic data☆179Updated 8 months ago
- Analysis of Chinese and English layouts 中英文版面分析☆238Updated 2 weeks ago
- Chat2Graph: Graph Native Agentic System.☆327Updated last week
- qwen models finetuning☆103Updated 5 months ago
- bge推理优化相关脚本☆29Updated last year
- A unified tool to generate fine-tuning datasets for LLMs, including questions, answers, and dialogues. ✨🤖📚💬☆61Updated 5 months ago
- Qwen-Efficient-Tuning☆44Updated 2 years ago
- NLP 项目记录档案☆58Updated 4 months ago
- 基于开源embedding模型的中文向量效果测试☆144Updated 2 years ago
- 雅意信息抽取大模型:在百万级人工构造的高质量信息抽取数据上进行指令微调,由中科闻歌算法团队研发。 (Repo for YAYI Unified Information Extraction Model)☆308Updated last year
- 通义千问VLLM推理部署DEMO☆596Updated last year