vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill
☆32Nov 7, 2025Updated 5 months ago
Alternatives and similar repositories for exvllm
Users that are interested in exvllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A "standard library" of Triton kernels.☆22Oct 2, 2025Updated 6 months ago
- LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …☆322Apr 7, 2026Updated last week
- 支持自定义配置API的Microsoft Word AI 写作助手加载项☆102Apr 9, 2026Updated last week
- ☆10Feb 18, 2024Updated 2 years ago
- Vstream - Video Analytics pipeline with Hardware based accelerations (dev - stage)☆10Feb 2, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Precision Knowledge Editing (PKE): A novel method to reduce toxicity in LLMs while preserving performance, with robust evaluations and ha…☆11Nov 26, 2024Updated last year
- ComfyUI nodes for CAD loading, manipulation, meshing. Using GMSH and OCC.☆22Mar 1, 2026Updated last month
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆11Jan 9, 2024Updated 2 years ago
- Exploring advanced prompting tools to query SQL database with multiple tables in natural language using LLMs☆16Aug 23, 2024Updated last year
- AI小说洗文工具☆17Jul 19, 2025Updated 8 months ago
- 完整开源！Java快速开发平台！基于Spring、SpringMVC、Mybatis架构，MStore提供更多好用的插件与模板（文章、商城、微信、论坛、会员、评论、支付、积分、工作流、任务调度等，同时提供上百套免费模板任意选择），价值源自分享！铭飞系统不仅一套简单好用的开源…☆12Jun 4, 2018Updated 7 years ago
- 本项目基于RuoYi-Vue框架为xiaozhi-esp32提供Java后端聊天服务器。帮助个人、企业快速部署的xiaozhi-esp32后端服务。☆23Jun 19, 2025Updated 9 months ago
- 基于 Spring Boot + MyBatis + Vue2 & Element 实现的OA协同办公系统。Flowable 工作流、动态表单自定义、正文盖章、知识库、日程等功能☆30Sep 8, 2025Updated 7 months ago
- 一个高性能的ComfyUI视频&图像放大插件，利用CUDA加速，支持多GPU、混合精度和Tensor Core优化。☆23Oct 26, 2025Updated 5 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆16Jul 18, 2023Updated 2 years ago
- ☆16Jan 16, 2025Updated last year
- ☆14May 1, 2023Updated 2 years ago
- Revision of official yolov7-pose to support custom dataset for keypoint detection☆11Nov 12, 2023Updated 2 years ago
- 2020湖南省第一届人工智能大赛参赛作品☆11Feb 17, 2022Updated 4 years ago
- S-Drama 短剧引擎 ai 全栈☆19Jun 22, 2025Updated 9 months ago
- [ECCV 2022] "TALISMAN: Targeted Active Learning for Object Detection with Rare Classes and Slices using Submodular Mutual Information" by…☆10Sep 21, 2022Updated 3 years ago
- ROUTE: Robust Multitask Tuning and Collaboration for Text-to-SQL (ICLR 2025 Pytorch Code)☆17May 15, 2025Updated 11 months ago
- Code release for "Category-Specific Prompts for Animal Action Recognition with Pretrained Vision-Language Models"☆14Feb 21, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆69Updated this week
- ☆15Apr 14, 2024Updated 2 years ago
- ☆11May 20, 2022Updated 3 years ago
- Implementation of SoundtStream from the paper: "SoundStream: An End-to-End Neural Audio Codec"☆13Jan 27, 2025Updated last year
- Official repository of Graph RAG-Tool Fusion and ToolLinkOS dataset.☆23Feb 13, 2025Updated last year
- ragflow中的ocr部分，非官方项目☆54Aug 26, 2024Updated last year
- 大语言模型工具集☆26Aug 1, 2025Updated 8 months ago
- WIP: Ofen is a toolkit aimed at making transformer models production-ready. API included☆17Oct 2, 2024Updated last year
- ☆10Feb 17, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 小智AI服务端全自动一键部署脚本☆41Dec 3, 2025Updated 4 months ago
- ☆15Sep 11, 2025Updated 7 months ago
- Code for Cross-dataset Training☆15Dec 27, 2020Updated 5 years ago
- BESA is a differentiable weight pruning technique for large language models.☆17Mar 4, 2024Updated 2 years ago
- Implementation of "Semi-Supervised Crowd Counting with Contextual Modeling: Facilitating Holistic Understanding of Crowd Scenes"☆12Oct 2, 2024Updated last year
- Implementing a Commercial Level Face Payment System with Yolo+Arcface （yolo + arcface 实现 商用级别人脸支付系统 ）☆11Sep 21, 2023Updated 2 years ago
- gradio bbox labeling tools☆11May 12, 2023Updated 2 years ago