Alternatives and similar repositories for xllamacpp

Users that are interested in xllamacpp are comparing it to the libraries listed below

• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆158Updated last month
• zai-org / GLM-Edge
  GLM Series Edge Models
  ☆149Updated 3 months ago
• shootime2021 / APUS-xDAN-4.0-moe
  Its an open source LLM based on MOE Structure.
  ☆58Updated last year
• modelscope / modelscope-studio
  A third-party component library based on Gradio. Integrates Ant Design, Ant Design X, and more advanced components to help you build appl…
  ☆116Updated this week
• LB-Young / Bambo
  Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…
  ☆34Updated 7 months ago
• AaronFeng753 / Better-Qwen3
  Auto Thinking Mode switch for Qwen3 in Open webui
  ☆67Updated 4 months ago
• OpenBMB / MobileCPM
  A Toolkit for Running On-device Large Language Models (LLMs) in APP
  ☆80Updated last year
• ClosedCharacter / Peach
  我们是第一个完全可商用的角色大模型。
  ☆40Updated last year
• woct0rdho / transformers-qwen3-moe-fused
  Fused Qwen3 MoE layer for faster training, compatible with HF Transformers, LoRA, 4-bit quant, Unsloth
  ☆171Updated this week
• 01-ai / Descartes
  ☆112Updated last year
• oumi-ai / halloumi-demo
  Try out HallOumi, a state-of-the-art claim verification model in a simple UI!
  ☆38Updated 5 months ago
• Tongyi-Zhiwen / QwenLong-L1
  ☆293Updated 3 months ago
• and270 / thinking_effort_processor
  ☆92Updated 2 months ago
• AgentEra / Agently-Talk-to-Control
  An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.
  ☆28Updated 11 months ago
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆275Updated 3 weeks ago
• krystalan / DRT
  Deep Reasoning Translation (DRT) Project
  ☆230Updated last week
• xverse-ai / XVERSE-MoE-A4.2B
  XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆39Updated last year
• thunlp / DeepNote
  ☆128Updated 5 months ago
• IEIT-Yuan / Yuan2.0-M32
  Mixture-of-Experts (MoE) Language Model
  ☆189Updated last year
• wade1010 / graphrag-ui
  The latest graphrag interface is used, using the local ollama to provide the LLM interface.Support for using the pip installation
  ☆154Updated 11 months ago
• uukuguy / speechless
  LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.
  ☆106Updated last month
• horus-ai-labs / DistillFlow
  Library for model distillation
  ☆150Updated this week
• ictnlp / FlexRAG
  FlexRAG: A RAG Framework for Information Retrieval and Generation.
  ☆219Updated 2 months ago
• liu-qingyuan / faster_whisper_gradio
  Real time faster whisper gradio
  ☆26Updated 3 weeks ago
• thunlp / Delta-CoMe
  Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024
  ☆56Updated 9 months ago
• chrschy / fact-finder
  ☆112Updated last year
• chuanruihu / Level-Navi-Agent-Search
  The Level-Navi Agent, a framework that requires no training and utilizes large language models for deep query understanding and precise s…
  ☆81Updated 8 months ago
• auliwenjiang / agentcp
  agentcp是一个基于ACP协议的Agent sdk，用于解决Agent间的身份认证及通信问题;用于创建AID、连接入网、构建会话，收发消息等;支持多Agent协作，异步消息处理，支持内网穿透，支持Agent访问的负载均衡
  ☆13Updated 2 months ago
• dubeno / NotebookLLM-Chinese
  Cross Platform Open Sourced Chinese NoteBookLM app based on Electron, Use DeepSeek + Reecho.ai
  ☆77Updated 10 months ago
• Tencent / AngelSlim
  Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
  ☆115Updated this week