Alternatives and similar repositories for exvllm

Users that are interested in exvllm are comparing it to the libraries listed below

• BryanMurkyChan / Project_Miao
  一起来养一只拥有专属记忆的AI猫猫吧！
  ☆10Updated last year
• hikariming / SynapseHub
  LLM智能路由网关、 Enterprise Intelligent AI-API Distribution Gateway
  ☆13Updated 9 months ago
• zRzRzRzRzRzRzR / lm-fly
  大模型推理框架加速，让 LLM 飞起来
  ☆21Updated last year
• pangpang-xuan / Private-doctor-bot
  基于大模型生成内容的智能语音对讲
  ☆10Updated last year
• Orion-zhen / roleplay-dataset
  收集优质的角色扮演聊天数据 | Collection of roleplay conversations of high quality
  ☆15Updated 11 months ago
• sugarforever / openai-swarm-tutorials
  ☆10Updated last year
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆65Updated last week
• MetaGLM / qingyan-cookbook
  Examples for QinYan GLMs
  ☆12Updated last year
• aixiaoxin123 / mcp_demo_project
  mcp的webui界面，支持客户端连接多个sse服务端，支持 openai、deepseek、qwen等大模型，另外附上构建的 agent的 stdio和sse的简单 天气查询的完整示例
  ☆36Updated 6 months ago
• liu-qingyuan / faster_whisper_gradio
  Real time faster whisper gradio
  ☆26Updated 3 months ago
• AgentEra / Agently-Talk-to-Control
  An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.
  ☆29Updated last year
• li-xiu-qi / x-pdf2md
  本项目借助飞桨平台，构建起一套创新的多模型协同系统，实现 PDF 文件到 Markdown 文件的高效、精准转换。
  ☆26Updated 7 months ago
• TylunasLi / fastllm
  纯c++的全平台llm加速库，支持python调用，支持chatglm-6B, llama, baichuan, moss基座，x86 / ARM
  ☆12Updated 2 months ago
• cyber-tao / openai_api_playground
  You can play any API server that compatible with OpenAI API
  ☆24Updated last year
• guqiong96 / Lvllm
  LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …
  ☆76Updated 2 weeks ago
• 2404589803 / hf-daily-paper-newsletter-chinese
  🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…
  ☆54Updated last week
• HimariO / llama.cpp.qwen2.5vl
  Port of Facebook's LLaMA model in C/C++
  ☆64Updated 6 months ago
• soulteary / dify-with-qwen-vl
  视频理解：千问视频多模态模型 & Dify
  ☆65Updated last year
• arcstep / illufly
  ✨🦋 illufly - 【幻蝶】基于记忆蒸馏、资料检索的自我进化智能体
  ☆74Updated this week
• yuruotong1 / xbrain
  通过装饰器将函数接入OpenAI的Chat
  ☆48Updated 8 months ago
• dubeno / NotebookLLM-Chinese
  Cross Platform Open Sourced Chinese NoteBookLM app based on Electron, Use DeepSeek + Reecho.ai
  ☆80Updated last year
• auliwenjiang / agentcp
  agentcp是一个基于ACP协议的Agent sdk，用于解决Agent间的身份认证及通信问题;用于创建AID、连接入网、构建会话，收发消息等;支持多Agent协作，异步消息处理，支持内网穿透，支持Agent访问的负载均衡
  ☆17Updated 4 months ago
• datawhalechina / smart-card-workshop
  An AI-powered content conversion tool that transforms text, web content, or HTML code into beautifully designed card images.一款基于AI的内容转换工…
  ☆32Updated 3 months ago
• rkuo2000 / GenAI
  ☆10Updated last week
• t6am3 / law_glm_baseline
  ☆15Updated last year
• chisaki-takahashi / dify2openai
  ☆11Updated last year
• allwefantasy / super-analysis-doc
  ☆19Updated last year
• ChaimEvans / ChatGLM_MultiGPUCPU_eval
  ✅4g GPU可用 | 简易实现ChatGLM单机调用多个计算设备（GPU、CPU）进行推理
  ☆34Updated 2 years ago
• LB-Young / Bambo
  Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…
  ☆34Updated 9 months ago
• Ninot1Quyi / Qwen2.5-Omni-multimodal-chat
  基于通义千问 Qwen2.5-Omni 的实时语音对话系统，使用在线API服务，支持实时语音交互、动态语音活动检测和流式音频处理。A real-time voice conversation system based on Qwen2.5-Omni Online-API, …
  ☆80Updated 6 months ago