vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill
☆32Nov 7, 2025Updated 8 months ago
Alternatives and similar repositories for exvllm
Users that are interested in exvllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A "standard library" of Triton kernels.☆26Oct 2, 2025Updated 9 months ago
- Precision Knowledge Editing (PKE): A novel method to reduce toxicity in LLMs while preserving performance, with robust evaluations and ha…☆11Nov 26, 2024Updated last year
- ComfyUI nodes for CAD loading, manipulation, meshing. Using GMSH and OCC.☆28Updated this week
- An implementation of MSSRM method☆10Mar 23, 2023Updated 3 years ago
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆11Jan 9, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Exploring advanced prompting tools to query SQL database with multiple tables in natural language using LLMs☆16Aug 23, 2024Updated last year
- Code for Rethinking Prompt Optimizers: From Prompt Merits to Optimization☆13Jan 12, 2026Updated 5 months ago
- 佛经☆15May 2, 2020Updated 6 years ago
- A Firefox Web Extension to run the DuckDuckGo AI Chat page on your sidebar☆15Feb 28, 2026Updated 4 months ago
- 基于 Spring Boot + MyBatis + Vue2 & Element 实现的OA协同办公系统。Flowable 工作流、动态表单自定义、正文盖章、知识库、日程等功能☆40Sep 8, 2025Updated 10 months ago
- ☆13Jan 22, 2025Updated last year
- ☆16Jul 18, 2023Updated 2 years ago
- ☆14May 1, 2023Updated 3 years ago
- Revision of official yolov7-pose to support custom dataset for keypoint detection☆11Nov 12, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [ACL 2025] iAgent: LLM Agent as a Shield between User and Recommender Systems☆32May 23, 2025Updated last year
- 2020湖南省第一届人工智能大赛参赛作品☆11Feb 17, 2022Updated 4 years ago
- S-Drama 短剧引擎 ai 全栈☆20Jun 22, 2025Updated last year
- [ECCV 2022] "TALISMAN: Targeted Active Learning for Object Detection with Rare Classes and Slices using Submodular Mutual Information" by…☆10Sep 21, 2022Updated 3 years ago
- ROUTE: Robust Multitask Tuning and Collaboration for Text-to-SQL (ICLR 2025 Pytorch Code)☆16May 15, 2025Updated last year
- Zen-NAS, a lightning fast, training-free Neural Architecture Searching algorithm☆11Nov 12, 2021Updated 4 years ago
- ☆12Aug 21, 2024Updated last year
- ☆112Jul 2, 2026Updated last week
- Code release for "Category-Specific Prompts for Animal Action Recognition with Pretrained Vision-Language Models"☆14Feb 21, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆27Sep 3, 2025Updated 10 months ago
- ☆14Apr 14, 2024Updated 2 years ago
- ☆12May 20, 2022Updated 4 years ago
- Implementation of SoundtStream from the paper: "SoundStream: An End-to-End Neural Audio Codec"☆13Jan 27, 2025Updated last year
- ☆13May 26, 2025Updated last year
- ragflow中的ocr部分，非官方项目☆54Aug 26, 2024Updated last year
- WIP: Ofen is a toolkit aimed at making transformer models production-ready. API included☆17Oct 2, 2024Updated last year
- ☆10Feb 17, 2024Updated 2 years ago
- ☆19Apr 7, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆18Apr 28, 2026Updated 2 months ago
- Code for Cross-dataset Training☆15Dec 27, 2020Updated 5 years ago
- BESA is a differentiable weight pruning technique for large language models.☆17Mar 4, 2024Updated 2 years ago
- Implementing a Commercial Level Face Payment System with Yolo+Arcface （yolo + arcface 实现 商用级别人脸支付系统 ）☆11May 18, 2026Updated last month
- gradio bbox labeling tools☆11May 12, 2023Updated 3 years ago
- ☆11Mar 22, 2024Updated 2 years ago
- Kevlar Benchmark: OWASP Top 10 for Agentic Apps (AI-Agents) 2026 a Red Team Benchmark☆36Jan 20, 2026Updated 5 months ago