Alternatives and similar repositories for xllamacpp:

Users that are interested in xllamacpp are comparing it to the libraries listed below

• LB-Young / Bambo
  Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…
  ☆35Updated 2 months ago
• jina-ai / deepsearch-ui
  Jina DeepSearch UI
  ☆95Updated this week
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆99Updated this week
• zRzRzRzRzRzRzR / GLM-4
  GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型
  ☆21Updated this week
• THUDM / GLM-Edge
  GLM Series Edge Models
  ☆136Updated 2 months ago
• and270 / thinking_effort_processor
  ☆85Updated last month
• AgentEra / Agently-Talk-to-Control
  An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.
  ☆27Updated 7 months ago
• modelscope / modelscope-studio
  A third-party component library based on Gradio.
  ☆95Updated last week
• liu-qingyuan / faster_whisper_gradio
  Real time faster whisper gradio
  ☆26Updated 6 months ago
• OpenBMB / MobileCPM
  A Toolkit for Running On-device Large Language Models (LLMs) in APP
  ☆72Updated 9 months ago
• xverse-ai / XVERSE-MoE-A36B
  XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆36Updated 7 months ago
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆56Updated 4 months ago
• uukuguy / speechless
  LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.
  ☆100Updated this week
• wade1010 / graphrag-ui
  The latest graphrag interface is used, using the local ollama to provide the LLM interface.Support for using the pip installation
  ☆146Updated 6 months ago
• shootime2021 / APUS-xDAN-4.0-moe
  Its an open source LLM based on MOE Structure.
  ☆58Updated 9 months ago
• microsoft / WizardLM2
  ☆59Updated last year
• appl-team / reppl
  Using APPL to reimplement popular algorithms for Large Language Models (LLMs) and prompts
  ☆43Updated 3 months ago
• oumi-ai / halloumi-demo
  Try out HallOumi, a state-of-the-art claim verification model in a simple UI!
  ☆30Updated 2 weeks ago
• Theigrams / g1
  g1: Using GPT-4o to create o1-like reasoning chains
  ☆20Updated 7 months ago
• amjadraza / pandasai-app-gradio
  ☆58Updated 6 months ago
• etalab-ia / albert-models
  Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.
  ☆42Updated 9 months ago
• dashscope / dash-cookbook
  Receipts for creating AI Applications with APIs from DashScope (and friends)!
  ☆51Updated 6 months ago
• nyunAI / PruneGPT
  ☆53Updated 10 months ago
• chuanruihu / Level-Navi-Agent-Search
  The Level-Navi Agent, a framework that requires no training and utilizes large language models for deep query understanding and precise s…
  ☆78Updated 3 months ago
• thunlp / Delta-CoMe
  Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024
  ☆57Updated 5 months ago
• ruzhila / voiceapi
  Streaming ASR and TTS based on FastAPI+ sherpa-onnx
  ☆95Updated 6 months ago
• SivilTaram / code-html-to-markdown
  A lightweight script for processing HTML page to markdown format with support for code blocks
  ☆79Updated last year
• etrobot / nextArtifacts
  A Next.js version of Claude Aritfacts , inspired by llamacoder
  ☆22Updated 6 months ago
• ClosedCharacter / Peach
  我们是第一个完全可商用的角色大模型。
  ☆39Updated 8 months ago
• read-agent / read-agent.github.io
  ☆51Updated 8 months ago