vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill
☆33Nov 7, 2025Updated 7 months ago
Alternatives and similar repositories for exvllm
Users that are interested in exvllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The complete NUMA-optimized branch of the ktransformers project☆25Nov 3, 2025Updated 7 months ago
- A "standard library" of Triton kernels.☆26Oct 2, 2025Updated 8 months ago
- LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …☆376Jun 8, 2026Updated last week
- 主要写er-nerf从零到一所有部署过程☆44Aug 28, 2024Updated last year
- ☆17Oct 15, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Vstream - Video Analytics pipeline with Hardware based accelerations (dev - stage)☆10Feb 2, 2024Updated 2 years ago
- Precision Knowledge Editing (PKE): A novel method to reduce toxicity in LLMs while preserving performance, with robust evaluations and ha…☆11Nov 26, 2024Updated last year
- An implementation of MSSRM method☆10Mar 23, 2023Updated 3 years ago
- AI bot management platform for conducting "lives" on TikTok, YouTube or X☆18Mar 23, 2025Updated last year
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆11Jan 9, 2024Updated 2 years ago
- Exploring advanced prompting tools to query SQL database with multiple tables in natural language using LLMs☆16Aug 23, 2024Updated last year
- AI小说洗文工具☆17Jul 19, 2025Updated 11 months ago
- 完整开源！Java快速开发平台！基于Spring、SpringMVC、Mybatis架构，MStore提供更多好用的插件与模板（文章、商城、微信、论坛、会员、评论、支付、积分、工作流、任务调度等，同时提供上百套免费模板任意选择），价值源自分享！铭飞系统不仅一套简单好用的开源…☆12Jun 4, 2018Updated 8 years ago
- Code for Rethinking Prompt Optimizers: From Prompt Merits to Optimization☆13Jan 12, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- official implementation of Training-free Boost for Open-Vocabulary Object Detection with Confidence Aggregation☆13Apr 15, 2024Updated 2 years ago
- 佛经☆15May 2, 2020Updated 6 years ago
- A Firefox Web Extension to run the DuckDuckGo AI Chat page on your sidebar☆15Feb 28, 2026Updated 3 months ago
- 基于 Spring Boot + MyBatis + Vue2 & Element 实现的OA协同办公系统。Flowable 工作流、动态表单自定义、正文盖章、知识库、日程等功能☆40Sep 8, 2025Updated 9 months ago
- ☆16Jul 18, 2023Updated 2 years ago
- ☆16Jan 16, 2025Updated last year
- ☆14May 1, 2023Updated 3 years ago
- Revision of official yolov7-pose to support custom dataset for keypoint detection☆11Nov 12, 2023Updated 2 years ago
- [ACL 2025] iAgent: LLM Agent as a Shield between User and Recommender Systems☆32May 23, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 2020湖南省第一届人工智能大赛参赛作品☆11Feb 17, 2022Updated 4 years ago
- S-Drama 短剧引擎 ai 全栈☆19Jun 22, 2025Updated 11 months ago
- [ECCV 2022] "TALISMAN: Targeted Active Learning for Object Detection with Rare Classes and Slices using Submodular Mutual Information" by…☆10Sep 21, 2022Updated 3 years ago
- 本项目基于RuoYi-Vue框架为xiaozhi-esp32提供Java后端聊天服务器。帮助个人、企业快速部署的xiaozhi-esp32后端服务。☆24Jun 19, 2025Updated last year
- ROUTE: Robust Multitask Tuning and Collaboration for Text-to-SQL (ICLR 2025 Pytorch Code)☆17May 15, 2025Updated last year
- Zen-NAS, a lightning fast, training-free Neural Architecture Searching algorithm☆11Nov 12, 2021Updated 4 years ago
- ☆12Aug 21, 2024Updated last year
- ☆109Updated this week
- ☆26Sep 3, 2025Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆12May 20, 2022Updated 4 years ago
- yolo目标检测算法☆15Jul 27, 2025Updated 10 months ago
- ☆13May 26, 2025Updated last year
- ragflow中的ocr部分，非官方项目☆54Aug 26, 2024Updated last year
- [AAAI 2026] ReCode: Reinforced Code Knowledge Editing for API Updates☆27Jul 1, 2025Updated 11 months ago
- ☆19Apr 7, 2025Updated last year
- ☆17Apr 28, 2026Updated last month