feiyun0112 / Local-LLM-Server
quick way to build a private large language model server and provide OpenAI-compatible interfaces | 快速搭建私有大语言模型(LLM)服务,提供OpenAI兼容接口
☆33Updated last year
Alternatives and similar repositories for Local-LLM-Server:
Users that are interested in Local-LLM-Server are comparing it to the libraries listed below
- 从langchain-ChatGLM基础上修改的一个可以加载TigerBot模型的基于本地知识库的问答应用,目标期望建立一套对中文场景与开源模型支持友好、可离线运行的知识库问答解决方案。☆106Updated last year
- ChatGPT WebUI using gradio. 给 LLM 对话和检索知识问答RAG提供一个简单好用的Web UI界面☆116Updated 6 months ago
- 部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ,实现了OpenAI中Chat, Models和Completions接口,包含流式响…☆89Updated last year
- aigc_serving lightweight and efficient Language service model reasoning☆24Updated 8 months ago
- ☆59Updated 4 months ago
- docker-PaddleOCR☆20Updated 11 months ago
- my-chatglm2 是基于 chatglm2 的 API 服务端 + 客户端一键启动方案。☆34Updated last year
- ☆66Updated last year
- Customize APIs from GLM, ChatGLM☆68Updated last month
- ☆37Updated 10 months ago
- bge-large-zh api service☆21Updated last year
- QA based on local knowledge and LLM.☆214Updated last month
- 这个仓库主要用于记录以MetaGPT为基础的Agent开发理论学习记录☆19Updated 9 months ago
- 利用LLM+敏感词库,来自动判别是否涉及敏感词。☆112Updated last year
- ☆74Updated last year
- 基于ChatGLM3基座模型和LLAMA-Factory框架进 行微调的一个中医问答机器人☆78Updated last year
- 演示 vllm 对中文大语言模型的神奇效果☆31Updated last year
- 以图搜图基于Towhee(resnet50 模型) + Milvus☆53Updated 6 months ago
- PaddleOCR 输出结果的行对齐,表格制式图像OCR行对齐☆44Updated 3 years ago
- Based on RapidOCR, extract the PDF content.☆146Updated 6 months ago
- lang2openai☆65Updated 4 months ago
- openai chatgpt or local llm(llama.cpp gguf format)+TTS+STT+Word+Excel☆92Updated 8 months ago
- Unsloth框架在Windows平台微调训练Qwen2大模型,非WSL☆53Updated 8 months ago
- zlai☆22Updated 5 months ago
- TianMu: A modern AI tool with multi-platform support, markdown support, multimodal, continuous conversation, and customizable commands. 一…☆83Updated last year
- 属于每个人的公众号”查特查特“上线啦!新问题、新方法、新发现,欢迎提PR!☆43Updated last year
- ✏️0成本LLM微调上手项目,⚡️一步一步使用colab训练法律LLM,基于microsoft/phi-1_5、chatglm3,包含lora微调,全参微调☆62Updated last year
- GPT+神器,简单实用的一站式AGI架构,内置本地化,LLM模型,agent,矢量数据库,智能链chain☆48Updated last year
- generate ppt with llm☆80Updated last year
- A simple way to deploy PaddleOCR based on FastAPI. (PaddleOCR 的 FastAPI 快速部署方案)☆111Updated 2 weeks ago