feiyun0112 / Local-LLM-ServerLinks
quick way to build a private large language model server and provide OpenAI-compatible interfaces | 快速搭建私有大语言模型(LLM)服务,提供OpenAI兼容接口
☆32Updated last year
Alternatives and similar repositories for Local-LLM-Server
Users that are interested in Local-LLM-Server are comparing it to the libraries listed below
Sorting:
- Convert files into markdown to help RAG or LLM understand, based on markitdown and MinerU, which could provide high quality pdf parser.☆99Updated 2 months ago
- 阿里SenseVoice的fastpi封装,采用onnx发布,体积更小,附带量化模型,支持GPU。支持从URL文件进行语音识别。☆87Updated 9 months ago
- openai chatgpt or local llm(llama.cpp gguf format)+TTS+STT+Word+Excel☆94Updated 11 months ago
- ☆57Updated 7 months ago
- gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。☆184Updated this week
- 小智同学测试工具(websocket)☆40Updated 3 months ago
- bge-large-zh api service☆23Updated last year
- ☆22Updated last month
- lang2openai☆70Updated 7 months ago
- Unsloth框架在Windows平台微调训练Qwen2大模型,非WSL☆60Updated 11 months ago
- 基于SenseVoice的funasr版本进行的api发布,可以无缝对接oneapi☆63Updated 9 months ago
- m3e-large-api☆17Updated last year
- ☆19Updated last month
- 流水线系统(pipeline)构建基于本地知识库的ChatGLM问答☆87Updated last year
- ✨🦋 illufly - 【幻蝶】基于记忆蒸馏、资料检索的自我进化智能体☆64Updated 2 weeks ago
- 一个LLM-Agent与PPT项目,支持基于对话式需求进行操作PPT的原生AI应用项目。模型为DeepSeek,基于LLM+VBA调用进行文档操作,轻量级ChatPPT服务。An LLM-Agent and PPT project that supports native …☆22Updated 3 months ago
- 属于每个人的公众号”查特查特“上线啦!新问题、新方法、新发现,欢迎提PR!☆45Updated last year
- 文本语料转训练集工具,txt转dataset☆92Updated last year
- 利用LLM+敏感词库,来自动判别是否涉及敏感词。☆124Updated last year
- Sample GLM4V + ChatTTS AI assistant☆84Updated 11 months ago
- ChatGPT WebUI using gradio. 给 LLM 对话和检索知识问答RAG提供一个简单好用的Web UI界面☆130Updated 9 months ago
- generate ppt with llm☆95Updated last year
- 以图搜图基于Towhee(resnet50 模型) + Milvus☆62Updated 9 months ago
- Dive into LLM Agents☆18Updated last year
- 微信、企微 群发系统 hook版本、ipad协议版,企微群发、微信群发,支持web网页操作,提供 api 接口,能快速实现微信聊天机器人、企 微聊天机器人☆22Updated 3 months ago
- A Dify tool plugin to export Markdown to DOCX, PPTX, XLSX, PDF, HTML, md files☆67Updated this week
- text security audit 安全审核-语义模型过滤 敏感内容检测系统☆23Updated 3 months ago
- ✅Deploy PaddleOCR with flask | 利用Flask对PaddleOCR进行部署,方便调用☆41Updated 2 years ago
- TPO 是一个优化 LLM 输出文本的框架,通过迭代反馈和优化提示的方式来“微调模型”,而非直接调整模型的参数,使模型在推理过程中与人类偏好对齐以生成更好的结果。本项目提供了一个友好的 WebUI 来加载模型,实时优化基础模型并展示最佳结果。☆10Updated 3 months ago
- Web one-click mode full process platform, including train data upload, fine-tuning, model merge, model deploy, gpu monitor etc., no need …☆19Updated last year