Alternatives and similar repositories for llama.cpp

Users that are interested in llama.cpp are comparing it to the libraries listed below

• Ikaros-521 / GraphRAG-Ollama-UI
  GraphRAG-Ollama-UI + GraphRAG4OpenWebUI 融合版（有gradio webui配置生成RAG索引，有fastapi提供RAG API服务）
  ☆105Updated last year
• KylinMountain / graphrag-server
  添加🚀流式 Web 服务到 GraphRAG，兼容 OpenAI SDK，支持可访问的实体链接🔗，支持建议问题，兼容本地嵌入模型，修复诸多问题。Add streaming web server to GraphRAG, compatible with OpenAI SD…
  ☆263Updated 10 months ago
• AARG-FAN / DesktopAI
  An common framework for voice and text interactions with LLMs
  ☆98Updated last year
• waveboy800 / bge-large-zh_api
  bge-large-zh api service
  ☆23Updated 2 years ago
• v3ucn / llama3-txt2json-dataset-maker
  文本语料转训练集工具，txt转dataset
  ☆93Updated last year
• win4r / o1
  Using Groq or OpenAI or Ollama to create o1-like reasoning chains
  ☆291Updated last year
• ptonlix / LangChain-SearXNG
  AI Q&A Search Engine ➡️ 基于LangChain和SearXNG打造的开源AI搜索引擎
  ☆216Updated 8 months ago
• Ikaros-521 / RealtimeSTT_LLM_TTS
  实时STT，连接OpenAI接口/智谱AI（流式LLM）和GPT-SOVITS/Edge-TTS，通过网页的方式，进行跨网络的服务调用，实现实时对话的效果
  ☆429Updated last year
• sugarforever / coolcrawl
  🔥 Turn entire websites into LLM-ready markdown
  ☆99Updated last year
• mengdahuang / dify-on-wechat
  ☆136Updated last year
• win4r / MoA
  ☆149Updated last year
• zaigie / bge-api
  BGE-large Embeddings api by FastAPI
  ☆43Updated 2 years ago
• Avdpro / ai2apps
  Setup AI2Apps at local system so you can use your own OpenAI key or make more back-end features.
  ☆438Updated this week
• tangwy-t / dify-on-wechat
  ☆33Updated last year
• brightwang / graphrag-dify
  ☆274Updated last year
• ultrasev / stream-whisper
  基于 faster-whisper 的伪实时语音转写服务
  ☆237Updated 9 months ago
• v3ucn / Unsloth-Windows-fineTuning-Qwen2
  Unsloth框架在Windows平台微调训练Qwen2大模型，非WSL
  ☆62Updated last year
• gan / glm4v-assistant
  Sample GLM4V + ChatTTS AI assistant
  ☆85Updated last year
• openaiee / openaiee
  OepnaiEE 支持多个 API 服务集成，包括 OpenAI、Groq、Gemini 和 Claude，使其能够在 Vercel 和 Netlify 等平台上快速部署。
  ☆125Updated 9 months ago
• svcvit / dify-sandbox-py
  A code executor for Dify that is compatible with the official sandbox API calls and dependency installation.
  ☆376Updated 9 months ago
• win4r / VideoFinder-Llama3.2-vision-Ollama
  VideoFinder is an advanced video analysis tool powered by multimodal AI, designed to help users easily locate and identify specific objec…
  ☆169Updated last year
• hikariming / pindata
  PinData is a modern, open-source dataset management platform designed specifically for large language model (LLM) training workflows
  ☆44Updated 7 months ago
• CrazyBoyM / phi3-Chinese
  Phi3 中文后训练模型仓库
  ☆324Updated last year
• RapidAI / LLM-EXAM
  大模型中文测试题库-民间版本
  ☆95Updated 2 years ago
• onenov / ChatBot-Next
  无缝集成处理和调度 Dify & Dify on WeChat，Web 可视化多用户管理/一键启动 ChatBot，简化了令人惊叹且响应迅速的 ChatBot 应用程序的创建。
  ☆71Updated last year
• jianchang512 / cosyvoice-api
  一个用于CosyVoice的api接口项目
  ☆335Updated 5 months ago
• caraxl / bge-reranker-base-api
  ☆16Updated 2 years ago
• LLM-Red-Team / zhipuai-agent-to-openai
  🌱 将智谱清言官方智能体API转换为OpenAI兼容协议的网关 👋 帮助开发者们降低接入API的门槛
  ☆49Updated last year
• win4r / GraphRAG4OpenWebUI
  GraphRAG4OpenWebUI integrates Microsoft's GraphRAG technology into Open WebUI, providing a versatile information retrieval API. It combin…
  ☆581Updated last year
• craii / ChatTTS_WebUI
  WebUI for ChatTTS
  ☆31Updated last year