vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill
☆32Nov 7, 2025Updated 6 months ago
Alternatives and similar repositories for exvllm
Users that are interested in exvllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The complete NUMA-optimized branch of the ktransformers project☆25Nov 3, 2025Updated 6 months ago
- A "standard library" of Triton kernels.☆26Oct 2, 2025Updated 7 months ago
- LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …☆366Apr 28, 2026Updated 3 weeks ago
- 主要写er-nerf从零到一所有部署过程☆44Aug 28, 2024Updated last year
- ☆17Oct 15, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆10Feb 18, 2024Updated 2 years ago
- Precision Knowledge Editing (PKE): A novel method to reduce toxicity in LLMs while preserving performance, with robust evaluations and ha…☆11Nov 26, 2024Updated last year
- An implementation of MSSRM method☆10Mar 23, 2023Updated 3 years ago
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆11Jan 9, 2024Updated 2 years ago
- Exploring advanced prompting tools to query SQL database with multiple tables in natural language using LLMs☆16Aug 23, 2024Updated last year
- AI小说洗文工具☆17Jul 19, 2025Updated 10 months ago
- 完整开源！Java快速开发平台！基于Spring、SpringMVC、Mybatis架构，MStore提供更多好用的插件与模板（文章、商城、微信、论坛、会员、评论、支付、积分、工作流、任务调度等，同时提供上百套免费模板任意选择），价值源自分享！铭飞系统不仅一套简单好用的开源…☆12Jun 4, 2018Updated 7 years ago
- Code for Rethinking Prompt Optimizers: From Prompt Merits to Optimization☆13Jan 12, 2026Updated 4 months ago
- official implementation of Training-free Boost for Open-Vocabulary Object Detection with Confidence Aggregation☆13Apr 15, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Firefox Web Extension to run the DuckDuckGo AI Chat page on your sidebar☆15Feb 28, 2026Updated 2 months ago
- 基于 Spring Boot + MyBatis + Vue2 & Element 实现的OA协同办公系统。Flowable 工作流、动态表单自定义、正文盖章、知识库、日程等功能☆37Sep 8, 2025Updated 8 months ago
- ☆13Jan 22, 2025Updated last year
- 一个高性能的ComfyUI视频&图像放大插件，利用CUDA加速，支持多GPU、混合精度和Tensor Core优化。☆23Oct 26, 2025Updated 7 months ago
- ☆16Jul 18, 2023Updated 2 years ago
- ☆16Jan 16, 2025Updated last year
- ☆14May 1, 2023Updated 3 years ago
- [ACL 2025] iAgent: LLM Agent as a Shield between User and Recommender Systems☆31May 23, 2025Updated last year
- 2020湖南省第一届人工智能大赛参赛作品☆11Feb 17, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- [ECCV 2022] "TALISMAN: Targeted Active Learning for Object Detection with Rare Classes and Slices using Submodular Mutual Information" by…☆10Sep 21, 2022Updated 3 years ago
- 本项目基于RuoYi-Vue框架为xiaozhi-esp32提供Java后端聊天服务器。帮助个人、企业快速部署的xiaozhi-esp32后端服务。☆23Jun 19, 2025Updated 11 months ago
- ROUTE: Robust Multitask Tuning and Collaboration for Text-to-SQL (ICLR 2025 Pytorch Code)☆17May 15, 2025Updated last year
- ☆12Aug 21, 2024Updated last year
- ☆107May 20, 2026Updated last week
- ☆26Sep 3, 2025Updated 8 months ago
- ☆12May 20, 2022Updated 4 years ago
- Implementation of SoundtStream from the paper: "SoundStream: An End-to-End Neural Audio Codec"☆13Jan 27, 2025Updated last year
- ☆13May 26, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Official repository of Graph RAG-Tool Fusion and ToolLinkOS dataset.☆23Feb 13, 2025Updated last year
- ragflow中的ocr部分，非官方项目☆54Aug 26, 2024Updated last year
- 大语言模型工具集☆28Aug 1, 2025Updated 9 months ago
- [AAAI 2026] ReCode: Reinforced Code Knowledge Editing for API Updates☆26Jul 1, 2025Updated 10 months ago
- ☆10Feb 17, 2024Updated 2 years ago
- ☆18Apr 7, 2025Updated last year
- ☆17Apr 28, 2026Updated 3 weeks ago