Alternatives and similar repositories for exvllm

Users that are interested in exvllm are comparing it to the libraries listed below

• BryanMurkyChan / Project_Miao
  一起来养一只拥有专属记忆的AI猫猫吧！
  ☆10Updated last year
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆68Updated last week
• aixiaoxin123 / mcp_demo_project
  mcp的webui界面，支持客户端连接多个sse服务端，支持 openai、deepseek、qwen等大模型，另外附上构建的 agent的 stdio和sse的简单 天气查询的完整示例
  ☆38Updated 7 months ago
• hikariming / SynapseHub
  LLM智能路由网关、 Enterprise Intelligent AI-API Distribution Gateway
  ☆13Updated 11 months ago
• Orion-zhen / roleplay-dataset
  收集优质的角色扮演聊天数据 | Collection of roleplay conversations of high quality
  ☆15Updated last year
• li-xiu-qi / x-pdf2md
  本项目借助飞桨平台，构建起一套创新的多模型协同系统，实现 PDF 文件到 Markdown 文件的高效、精准转换。
  ☆27Updated 9 months ago
• TylunasLi / fastllm
  纯c++的全平台llm加速库，支持python调用，支持chatglm-6B, llama, baichuan, moss基座，x86 / ARM
  ☆12Updated 3 months ago
• liu-qingyuan / faster_whisper_gradio
  Real time faster whisper gradio
  ☆25Updated 4 months ago
• guqiong96 / Lvllm
  LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …
  ☆98Updated this week
• AgentEra / Agently-Talk-to-Control
  An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.
  ☆29Updated last year
• li-xiu-qi / HearSight
  HearSight智能音视频内容分析工具，支持多源视频(包括 URL和上传文件方式)导入能够从输入的视频源中提取上下文信息，从而提供更精准的 AI问答交互。平台基于视频语义单元进行智能切片，用户可通过问答方式灵活调整切片维度，快速定位所需内容同时，HearSight支持自动…
  ☆31Updated 3 weeks ago
• MetaGLM / qingyan-cookbook
  Examples for QinYan GLMs
  ☆13Updated last year
• arcstep / illufly
  ✨🦋 illufly - 【幻蝶】基于记忆蒸馏、资料检索的自我进化智能体
  ☆74Updated last month
• zai-org / GLM-Edge
  GLM Series Edge Models
  ☆156Updated 6 months ago
• zRzRzRzRzRzRzR / lm-fly
  大模型推理框架加速，让 LLM 飞起来
  ☆24Updated last year
• infiniflow / ragflow-docs
  ☆60Updated this week
• auliwenjiang / agentcp
  agentcp是一个基于ACP协议的Agent sdk，用于解决Agent间的身份认证及通信问题;用于创建AID、连接入网、构建会话，收发消息等;支持多Agent协作，异步消息处理，支持内网穿透，支持Agent访问的负载均衡
  ☆18Updated 5 months ago
• modelscope / mcp-central
  Collection of model-centric MCP servers
  ☆24Updated 7 months ago
• RUC-NLPIR / FinSight
  FinSight: Towards Real-World Financial Deep Research. 🎯One ticker, one click, one publication-ready report.
  ☆86Updated this week
• shareAI-lab / LocalManus
  A open version Manus.
  ☆69Updated 9 months ago
• glide-the / InterpretationoDreams
  基于langchain设计的智能体任务，包含规划会话场景资源，构建子任务，任务执行器包含（MCTS）
  ☆32Updated last month
• yishuizhe / Dream-Moments-Dify
  基于 KouriChat 的 Dify 集成情感陪伴机器人，支持微信，增强 AI 交互。
  ☆41Updated 10 months ago
• OpenSQZ / MiniCPM-V-CookBook
  Cook up amazing multimodal AI applications effortlessly with MiniCPM-o
  ☆231Updated 3 weeks ago
• weidwonder / crawl4ai-mcp-server
  用于提供给本地开发者的 LLM的高效互联网搜索&内容获取的MCP Server， 节省你的token
  ☆126Updated 7 months ago
• li-xiu-qi / Smartlmager
  一个基于多模态向量模型及视觉多模态模型构建的图片搜索引擎&管理系统，实现精准的以文搜文，文搜图、以图搜图多种智能检索方式。An image search engine management system built upon multimodal vector models…
  ☆76Updated 3 months ago
• Alannikos / FunGPT
  In this fast-paced world, we all need a little something to spice up life. Whether you need a glass of sweet talk to lift your spirits or…
  ☆60Updated 7 months ago
• habout632 / llms
  llms related stuff , including code, docs
  ☆13Updated 10 months ago
• ninehills / embedding_finetuning
  Fine-tuning embedding models.
  ☆15Updated last year
• chuanruihu / Level-Navi-Agent-Search
  The Level-Navi Agent, a framework that requires no training and utilizes large language models for deep query understanding and precise s…
  ☆82Updated last year
• tpoisonooo / ROGRAG
  [ACL2025 demo track] ROGRAG: A Robustly Optimized GraphRAG Framework
  ☆189Updated 3 weeks ago