A high-throughput and memory-efficient inference and serving engine for LLMs
☆39Jun 24, 2026Updated 3 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆74Sep 15, 2026Updated last week
- [NeurIPS 25] InfiniPot-V: Memory-Constrained KV Cache Compression for Streaming Video Understanding☆24Jan 25, 2026Updated 7 months ago
- DeepSeek-V4 Lecture☆31Aug 10, 2026Updated last month
- A retrieval augmented sequence modeling toolkit implemented based on Fairseq☆29Mar 3, 2023Updated 3 years ago
- An interactive companion toy that engages kids with storytelling, singing, and encouragement for physical activities using advanced AI t…☆10Oct 15, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- my dockerfiles☆13Sep 10, 2026Updated 2 weeks ago
- Official implementation of A cappella: Audio-visual Singing VoiceSeparation, from BMVC21☆18May 14, 2022Updated 4 years ago
- MacPilot CLI is a mcp server, It provides a collection of system tools that allow AI assistants to perform various operations on macOS sy…☆16May 10, 2025Updated last year
- deduplication☆15Feb 20, 2023Updated 3 years ago
- Policy-driven seamless lazy loading☆29Sep 17, 2026Updated last week
- This is a template for building Flutter applications for Android, which includes basic dynamic themes, theme settings, language settings …☆12May 19, 2026Updated 4 months ago
- Resource scheduling and cluster management for AI☆15Jun 29, 2023Updated 3 years ago
- vmarker (Auto Chapter Bar or `acb` in CLI) is an open-source Python tool that converts SRT subtitle files into transparent video chapter …☆19May 4, 2026Updated 4 months ago
- rdiv!(::AbstractMatrix, ::UpperTriangular) and ldiv!(::LowerTriangular, ::AbstractMatrix)☆11Aug 15, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆75Mar 26, 2025Updated last year
- Waf based on caddy2☆22Jul 21, 2022Updated 4 years ago
- [TAI 2025] Official implementation of TAI-accepted paper: ShadowMaskFormer: Mask Augmented Patch Embedding for Shadow Removal☆15May 8, 2025Updated last year
- Socat一键安装脚本，可转发TCP和UDP流量，支持IPv4和IPv6☆15Jun 25, 2026Updated 2 months ago
- ☆14Mar 11, 2025Updated last year
- Community maintained hardware plugin for vLLM on Huawei Ascend☆2,882Updated this week
- NumGLUE: A Suite of Fundamental yet Challenging Mathematical Reasoning Tasks☆20May 10, 2022Updated 4 years ago
- 数据标注工具label-studio汉化版☆17Jul 16, 2021Updated 5 years ago
- ☆79Dec 15, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A dynamic GPU memory allocator, suitable for warp synchronized scenarios.☆11Aug 20, 2019Updated 7 years ago
- ocr照片识别文字,包括裁剪图片,能识别中文和英文,是现有网上资源中识别率最好的☆14Sep 20, 2016Updated 10 years ago
- ☆19Feb 25, 2026Updated 6 months ago
- NJUNMT for docNMT☆16Sep 9, 2020Updated 6 years ago
- Claude Code skill: Analyze a Xiaohongshu (小红书) account - scrape notes, covers, and generate a 7-dimension methodology report with interac…☆25Mar 3, 2026Updated 6 months ago
- Code to obtain the training data for the ACL 2018 paper "Neural Document Summarization by Jointly Learning to Score and Select Sentences…☆17Jul 5, 2019Updated 7 years ago
- ☆25Dec 9, 2024Updated last year
- An MPI wrapper for the pytorch tensor library that is automatically differentiable☆10Mar 27, 2023Updated 3 years ago
- [ICLR 2023] PyTorch code of Summarization Programs: Interpretable Abstractive Summarization with Neural Modular Trees☆23Jun 19, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 本书是《5G Mobile Networks : A Systems Approach》（https://5g.systemsapproach.org/）的中文版翻译。☆13Jun 26, 2022Updated 4 years ago
- FTRL-Proximal Online Learning Algorithm☆15May 22, 2017Updated 9 years ago
- ☆36Jul 27, 2026Updated last month
- ☆33May 15, 2019Updated 7 years ago
- allowing R users to work with dlib through Rcpp☆13Apr 11, 2018Updated 8 years ago
- Distributed SDDMM Kernel☆13Jul 8, 2022Updated 4 years ago
- Automatic Workspace Calibration Using Homography for Pick and Place - IEEE CASE 2023, Auckland, New Zealand | DOI: 10.1109/CASE56687.20…☆20May 26, 2023Updated 3 years ago