Alternatives and similar repositories for xllamacpp:

Users that are interested in xllamacpp are comparing it to the libraries listed below

• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆109Updated 3 weeks ago
• LB-Young / Bambo
  Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…
  ☆35Updated 3 months ago
• THUDM / GLM-Edge
  GLM Series Edge Models
  ☆138Updated 2 months ago
• modelscope / modelscope-studio
  A third-party component library based on Gradio.
  ☆97Updated this week
• AaronFeng753 / Better-Qwen3
  Auto Thinking Mode switch for Qwen3 in Open webui
  ☆50Updated this week
• chuanruihu / Level-Navi-Agent-Search
  The Level-Navi Agent, a framework that requires no training and utilizes large language models for deep query understanding and precise s…
  ☆78Updated 4 months ago
• jina-ai / deepsearch-ui
  Jina DeepSearch UI
  ☆104Updated this week
• snekkenull / translation-agent-webui
  A gradio webui for Andrewyng translation-agent
  ☆29Updated 5 months ago
• allwefantasy / super-analysis-doc
  ☆19Updated 7 months ago
• oumi-ai / halloumi-demo
  Try out HallOumi, a state-of-the-art claim verification model in a simple UI!
  ☆33Updated last month
• and270 / thinking_effort_processor
  ☆88Updated 2 months ago
• ClosedCharacter / Peach
  我们是第一个完全可商用的角色大模型。
  ☆40Updated 9 months ago
• SivilTaram / code-html-to-markdown
  A lightweight script for processing HTML page to markdown format with support for code blocks
  ☆79Updated last year
• xverse-ai / XVERSE-MoE-A4.2B
  XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆38Updated last year
• wey-gu / grpo-graph-extraction
  Qwen GRPO Graph Extraction RL Finetune
  ☆46Updated last month
• shootime2021 / APUS-xDAN-4.0-moe
  Its an open source LLM based on MOE Structure.
  ☆58Updated 10 months ago
• microsoft / WizardLM2
  ☆59Updated last year
• OpenBMB / MobileCPM
  A Toolkit for Running On-device Large Language Models (LLMs) in APP
  ☆72Updated 10 months ago
• kv1830 / fast_pdf_trans
  Fast pdf translate是一款pdf翻译软件，基于MinerU实现pdf转markdown的功能，接着对markdown进行分割， 送给大模型翻译，最后组装翻译结果并由pypandoc生成结果pdf。
  ☆18Updated last month
• anakin87 / qwen-scheduler-grpo
  Train a Language Model with GRPO to create a schedule from a list of events and priorities
  ☆145Updated last week
• ninehills / langeval
  Evaluation for AI apps and agent
  ☆41Updated last year
• junjiem / dify-plugin-mcp_compat_dify_tools
  Dify 1.0 Plugin Convert your Dify tools's API to MCP compatible API
  ☆20Updated 2 weeks ago
• appl-team / reppl
  Using APPL to reimplement popular algorithms for Large Language Models (LLMs) and prompts
  ☆44Updated 3 months ago
• AgentEra / Agently-Talk-to-Control
  An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.
  ☆27Updated 7 months ago
• wade1010 / graphrag-ui
  The latest graphrag interface is used, using the local ollama to provide the LLM interface.Support for using the pip installation
  ☆147Updated 7 months ago
• liu-qingyuan / faster_whisper_gradio
  Real time faster whisper gradio
  ☆26Updated 7 months ago
• infinigence / InfiniWebSearch
  A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.
  ☆37Updated 4 months ago
• thunlp / DeepNote
  ☆94Updated last month
• dashscope / dash-cookbook
  Receipts for creating AI Applications with APIs from DashScope (and friends)!
  ☆51Updated 7 months ago
• amjadraza / pandasai-app-gradio
  ☆57Updated 6 months ago