A high-throughput and memory-efficient inference and serving engine for LLMs
☆39Jun 24, 2026Updated 3 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆74Sep 22, 2026Updated 3 weeks ago
- Official code for Guiding Language Model Math Reasoning with Planning Tokens☆21Feb 29, 2024Updated 2 years ago
- ☆12Mar 21, 2024Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆19Sep 7, 2026Updated last month
- [NeurIPS 25] InfiniPot-V: Memory-Constrained KV Cache Compression for Streaming Video Understanding☆24Jan 25, 2026Updated 8 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 2SSP: A Two-Stage Framework for Structured Pruning of LLMs☆22Aug 18, 2025Updated last year
- Pytorch implementation of "Very Deep Graph Neural Networks via Noise Regularisation"☆10Aug 22, 2021Updated 5 years ago
- A retrieval augmented sequence modeling toolkit implemented based on Fairseq☆29Mar 3, 2023Updated 3 years ago
- Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference☆172Oct 13, 2025Updated last year
- 支持Taiyi-Diffusion-XL模型的Fooocus☆19Apr 27, 2024Updated 2 years ago
- my dockerfiles☆13Sep 10, 2026Updated last month
- GazeML的模型导出☆12May 21, 2020Updated 6 years ago
- Code for "Skill-based Chain-of-Thoughts for Domain-Adaptive Video Reasoning [EMNLP 2025 Findings]"☆18Aug 27, 2025Updated last year
- React app for inspecting, building and debugging with the Realtime API☆11Nov 5, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official implementation of A cappella: Audio-visual Singing VoiceSeparation, from BMVC21☆18May 14, 2022Updated 4 years ago
- ts视频数据的解析代码，得到裸pes或者es数据☆10Jun 11, 2019Updated 7 years ago
- MacPilot CLI is a mcp server, It provides a collection of system tools that allow AI assistants to perform various operations on macOS sy…☆16May 10, 2025Updated last year
- ☆32May 26, 2024Updated 2 years ago
- ☆17May 5, 2024Updated 2 years ago
- rdiv!(::AbstractMatrix, ::UpperTriangular) and ldiv!(::LowerTriangular, ::AbstractMatrix)☆11Aug 15, 2026Updated last month
- ☆75Mar 26, 2025Updated last year
- The documentation site for TDEP.☆28Aug 17, 2023Updated 3 years ago
- Julia implementation of flash-attention operation for neural networks.☆11May 31, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Community maintained hardware plugin for vLLM on Huawei Ascend☆2,979Updated this week
- ☆79Dec 15, 2023Updated 2 years ago
- Sparse symmetric indefinite solver implemented with a runtime system☆13May 11, 2020Updated 6 years ago
- Automatic differentiation of FEniCS and Firedrake models in Julia☆14Mar 21, 2021Updated 5 years ago
- SQL Optimizations using MLIR☆12Apr 5, 2020Updated 6 years ago
- a ros node using face_net do face_recognition☆12Jul 27, 2016Updated 10 years ago
- ocr照片识别文字,包括裁剪图片,能识别中文和英文,是现有网上资源中识别率最好的☆14Sep 20, 2016Updated 10 years ago
- NJUNMT for docNMT☆16Sep 9, 2020Updated 6 years ago
- ☆30Jul 22, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ThinK: Thinner Key Cache by Query-Driven Pruning☆30Jun 2, 2026Updated 4 months ago
- Bagua tutorials.☆13Sep 4, 2022Updated 4 years ago
- FTRL-Proximal Online Learning Algorithm☆15May 22, 2017Updated 9 years ago
- 基于redis-stream的延迟队列☆14Oct 24, 2022Updated 3 years ago
- ☆37Jul 27, 2026Updated 2 months ago
- allowing R users to work with dlib through Rcpp☆13Apr 11, 2018Updated 8 years ago
- Automatic Workspace Calibration Using Homography for Pick and Place - IEEE CASE 2023, Auckland, New Zealand | DOI: 10.1109/CASE56687.20…☆20May 26, 2023Updated 3 years ago