Alternatives and similar repositories for xllamacpp

Users that are interested in xllamacpp are comparing it to the libraries listed below

• AaronFeng753 / Better-Qwen3
  Auto Thinking Mode switch for Qwen3 in Open webui
  ☆70Updated 6 months ago
• modelscope / modelscope-studio
  A third-party component library based on Gradio. Integrates Ant Design, Ant Design X, Monaco Editor and more advanced components to help…
  ☆130Updated last week
• Tencent / POINTS-Reader
  ☆185Updated 2 months ago
• LB-Young / Bambo
  Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…
  ☆34Updated 9 months ago
• horus-ai-labs / DistillFlow
  Library for model distillation
  ☆158Updated 2 months ago
• oumi-ai / halloumi-demo
  Try out HallOumi, a state-of-the-art claim verification model in a simple UI!
  ☆41Updated 8 months ago
• shootime2021 / APUS-xDAN-4.0-moe
  Its an open source LLM based on MOE Structure.
  ☆58Updated last year
• zai-org / GLM-Edge
  GLM Series Edge Models
  ☆153Updated 5 months ago
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆177Updated 4 months ago
• and270 / thinking_effort_processor
  ☆94Updated 4 months ago
• OpenBMB / MobileCPM
  A Toolkit for Running On-device Large Language Models (LLMs) in APP
  ☆79Updated last year
• thunlp / Delta-CoMe
  Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024
  ☆59Updated last year
• alibaba / app-controller
  App-Controller: Allow users to manipulate your App with natural language
  ☆131Updated last year
• jina-ai / deepsearch-ui
  Jina DeepSearch UI
  ☆126Updated 3 months ago
• 01-ai / Descartes
  ☆113Updated last year
• lutongyv / Textin_Tester
  如需体验textin文档解析，请点击https://cc.co/16YSIy
  ☆22Updated last year
• xverse-ai / XVERSE-MoE-A4.2B
  XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆39Updated last year
• Tongyi-Zhiwen / Qwen-Doc
  ☆300Updated 6 months ago
• uukuguy / speechless
  LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.
  ☆106Updated 4 months ago
• ClosedCharacter / Peach
  我们是第一个完全可商用的角色大模型。
  ☆40Updated last year
• wade1010 / graphrag-ui
  The latest graphrag interface is used, using the local ollama to provide the LLM interface.Support for using the pip installation
  ☆155Updated last year
• lwyBZss8924d / DeepSearchAgents
  DeepSearch Code-Actions Agent (DSCA). Build 🙌 with 🤗 smolagents
  ☆125Updated 3 months ago
• chuanruihu / Level-Navi-Agent-Search
  The Level-Navi Agent, a framework that requires no training and utilizes large language models for deep query understanding and precise s…
  ☆81Updated 11 months ago
• xverse-ai / XVERSE-MoE-A36B
  XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆38Updated last year
• Alibaba-NLP / MaskSearch
  Repo for "MaskSearch: A Universal Pre-Training Framework to Enhance Agentic Search Capability"
  ☆146Updated 6 months ago
• UGAIForge / AgileGen
  AgileGen: Empowering Agile-Based Generative Software Development through Human-AI Teamwork (accepted by ACM TOSEM)
  ☆23Updated last year
• krystalan / DRT
  Deep Reasoning Translation (DRT) Project
  ☆239Updated 3 months ago
• junjiem / dify-plugin-mcp_compat_dify_tools
  Dify 1.0 Plugin Convert your Dify tools's API to MCP compatible API
  ☆23Updated 7 months ago
• allwefantasy / super-analysis-doc
  ☆19Updated last year
• jina-ai / llm-query-expansion
  Query Expension for Better Query Embedding using LLMs
  ☆62Updated 9 months ago