Alternatives and similar repositories for ollama

Users that are interested in ollama are comparing it to the libraries listed below

• shell-nlp / gpt_server
  gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。
  ☆194Updated this week
• RapidAI / LLM-EXAM
  大模型中文测试题库-民间版本
  ☆84Updated 2 years ago
• magicyuan876 / mineru-server
  MinerU API Server
  ☆18Updated 9 months ago
• hustyichi / dify-rag
  dify's rag patch module
  ☆249Updated 3 weeks ago
• KylinMountain / markify
  Convert files into markdown to help RAG or LLM understand, based on markitdown and MinerU, which could provide high quality pdf parser.
  ☆111Updated 3 months ago
• zjrwtx / SFT-data-builder
  利用免费的大模型api来结合你的私域数据来生成sft训练数据（妥妥白嫖）支持llamafactory等工具的训练数据格式synthetic data
  ☆168Updated 7 months ago
• KylinMountain / graphrag-server
  添加🚀流式 Web 服务到 GraphRAG，兼容 OpenAI SDK，支持可访问的实体链接🔗，支持建议问题，兼容本地嵌入模型，修复诸多问题。Add streaming web server to GraphRAG, compatible with OpenAI SD…
  ☆254Updated 3 months ago
• OpenSearch-AI / OpenSearch-SQL
  OpenSearch-SQL code
  ☆125Updated last month
• langgenius / dify-plugin-daemon
  ☆250Updated this week
• lework / llm-benchmark
  LLM 并发性能测试工具，支持自动化压力测试和性能报告生成。
  ☆101Updated 3 months ago
• hyperai / vllm-cn
  vLLM Documentation in Chinese Simplified / vLLM 中文文档
  ☆80Updated last month
• ymcui / Chinese-Mixtral
  中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）
  ☆603Updated last year
• junjiem / dify-plugin-agent-mcp_sse
  Dify 1.0 Plugin Support MCP Tools Agent strategies
  ☆92Updated last week
• deansaco / r1-reasoning-rag
  recursive rag with r1 reasoning
  ☆325Updated last month
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆238Updated 3 months ago
• zstar1003 / ragflow-plus
  Ragflow-Plus 是 Ragflow 的二次开发版本，使其更为简洁实用
  ☆653Updated this week
• aigc-apps / PAI-RAG
  An easy-to-use framework for modular RAG
  ☆372Updated this week
• billvsme / my_openai_api
  部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ，实现了OpenAI中Chat, Models和Completions接口，包含流式响…
  ☆94Updated last year
• brightwang / graphrag-dify
  ☆250Updated 6 months ago
• FlagOpen / FlagData
  ☆339Updated last year
• TuGraph-family / chat2graph
  Chat2Graph: Graph Native Agentic System.
  ☆251Updated last week
• XGenerationLab / xiyan_mcp_server
  A Model Context Protocol (MCP) server that enables natural language queries to databases
  ☆167Updated last month
• MigoXLab / dingo
  Dingo: A Comprehensive AI Data Quality Evaluation Tool
  ☆255Updated this week
• chatchat-space / LangGraph-Chatchat
  ☆125Updated 3 months ago
• NanGePlus / KagTest
  KAG开源框架介绍及使用KAG实现知识增强生成应用(产品模式测试、开发者模式测试)，KAG是OpenSPG发布v0.5版本中推出的知识增强生成（KAG）的专业领域知识服务框架，旨在充分利用知识图谱和向量检索的优势，增强大型语言模型和知识图谱，以解决 RAG 挑战
  ☆122Updated 2 months ago
• zj591227045 / DeepStressModel
  ☆155Updated 3 months ago
• labring / aiproxy
  AI Proxy is a high-performance AI gateway using OpenAI's protocol as the entry point. It features intelligent error handling, multi-chann…
  ☆109Updated this week
• RapidAI / RapidLayout
  Analysis of Chinese and English layouts 中英文版面分析
  ☆218Updated last week
• Alibaba-NLP / ViDoRAG
  ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agents
  ☆499Updated 2 weeks ago
• CrazyBoyM / phi3-Chinese
  Phi3 中文后训练模型仓库
  ☆321Updated 7 months ago