Alternatives and similar repositories for exvllm

Users that are interested in exvllm are comparing it to the libraries listed below

• BryanMurkyChan / Project_Miao
  一起来养一只拥有专属记忆的AI猫猫吧！
  ☆10Updated last year
• aixiaoxin123 / mcp_demo_project
  mcp的webui界面，支持客户端连接多个sse服务端，支持 openai、deepseek、qwen等大模型，另外附上构建的 agent的 stdio和sse的简单 天气查询的完整示例
  ☆37Updated 6 months ago
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆66Updated 2 weeks ago
• hikariming / SynapseHub
  LLM智能路由网关、 Enterprise Intelligent AI-API Distribution Gateway
  ☆13Updated 10 months ago
• li-xiu-qi / x-pdf2md
  本项目借助飞桨平台，构建起一套创新的多模型协同系统，实现 PDF 文件到 Markdown 文件的高效、精准转换。
  ☆27Updated 8 months ago
• Orion-zhen / roleplay-dataset
  收集优质的角色扮演聊天数据 | Collection of roleplay conversations of high quality
  ☆15Updated last year
• TylunasLi / fastllm
  纯c++的全平台llm加速库，支持python调用，支持chatglm-6B, llama, baichuan, moss基座，x86 / ARM
  ☆12Updated 3 months ago
• zRzRzRzRzRzRzR / lm-fly
  大模型推理框架加速，让 LLM 飞起来
  ☆24Updated last year
• pangpang-xuan / Private-doctor-bot
  基于大模型生成内容的智能语音对讲
  ☆10Updated last year
• MetaGLM / qingyan-cookbook
  Examples for QinYan GLMs
  ☆13Updated last year
• cyber-tao / openai_api_playground
  You can play any API server that compatible with OpenAI API
  ☆24Updated last year
• AgentEra / Agently-Talk-to-Control
  An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.
  ☆29Updated last year
• arcstep / illufly
  ✨🦋 illufly - 【幻蝶】基于记忆蒸馏、资料检索的自我进化智能体
  ☆75Updated last week
• limafang / Xtuner-GUI
  Built on the robust XTuner backend framework, XTuner Chat GUI offers a user-friendly platform for quick and efficient local model inferen…
  ☆13Updated last year
• habout632 / llms
  llms related stuff , including code, docs
  ☆13Updated 9 months ago
• liu-qingyuan / faster_whisper_gradio
  Real time faster whisper gradio
  ☆25Updated 3 months ago
• 2404589803 / hf-daily-paper-newsletter-chinese
  🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…
  ☆54Updated last week
• glide-the / InterpretationoDreams
  基于langchain设计的智能体任务，包含规划会话场景资源，构建子任务，任务执行器包含（MCTS）
  ☆31Updated last month
• t6am3 / law_glm_baseline
  ☆15Updated last year
• auliwenjiang / agentcp
  agentcp是一个基于ACP协议的Agent sdk，用于解决Agent间的身份认证及通信问题;用于创建AID、连接入网、构建会话，收发消息等;支持多Agent协作，异步消息处理，支持内网穿透，支持Agent访问的负载均衡
  ☆18Updated 5 months ago
• datawhalechina / smart-card-workshop
  An AI-powered content conversion tool that transforms text, web content, or HTML code into beautifully designed card images.一款基于AI的内容转换工…
  ☆32Updated 4 months ago
• sanbuphy / SmartPaper
  A mini assistant to help you read paper quickly
  ☆54Updated 7 months ago
• Alibaba-NLP / MaskSearch
  Repo for "MaskSearch: A Universal Pre-Training Framework to Enhance Agentic Search Capability"
  ☆146Updated 6 months ago
• guqiong96 / Lvllm
  LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …
  ☆87Updated this week
• chuanruihu / Level-Navi-Agent-Search
  The Level-Navi Agent, a framework that requires no training and utilizes large language models for deep query understanding and precise s…
  ☆81Updated 11 months ago
• eogee / any4any
  any4any是一个企业级多模态AI平台，提供完整的智能交互解决方案。集成了大语言模型对话、数字人系统、智能SQL查询、语音处理、知识库系统等核心功能，支持OpenAI兼容API接口，可无缝集成到各类AI应用中。
  ☆55Updated last month
• Alannikos / FunGPT
  In this fast-paced world, we all need a little something to spice up life. Whether you need a glass of sweet talk to lift your spirits or…
  ☆60Updated 6 months ago
• li-xiu-qi / Smartlmager
  一个基于多模态向量模型及视觉多模态模型构建的图片搜索引擎&管理系统，实现精准的以文搜文，文搜图、以图搜图多种智能检索方式。An image search engine management system built upon multimodal vector models…
  ☆75Updated 2 months ago
• boleyn / fastgpt-dataset-mcp
  解决知识库搜索需要手动编排流和意图识别的问题
  ☆19Updated 5 months ago
• modelscope / mcp-central
  Collection of model-centric MCP servers
  ☆24Updated 6 months ago