☆33Apr 19, 2025Updated last year
Alternatives and similar repositories for vLLM-Benchmark
Users that are interested in vLLM-Benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A collection of reproducible inference engine benchmarks☆38Apr 22, 2025Updated last year
- ☆19Oct 22, 2026Updated 3 weeks ago
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆38Aug 29, 2025Updated last year
- CS294-162; Machine Learning Systems Seminar☆32Apr 11, 2023Updated 3 years ago
- ☆11Nov 16, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A high-throughput and memory-efficient inference and serving engine for LLMs☆14Updated this week
- Transformer related optimization, including BERT, GPT☆17Jul 29, 2023Updated 3 years ago
- A service for launching containerized processes on cloud infrastructure.☆12Nov 16, 2023Updated 3 years ago
- vLLM Daily Summarization of Merged PRs☆56Updated this week
- Estimate the throughput of OAI compatible servers☆22Oct 14, 2026Updated last month
- ☆30Nov 2, 2026Updated 2 weeks ago
- [ACL 2024] (Oral) LRQuant: Learnable and Robust Post-Training Quantization for Large Language Models☆12Apr 6, 2026Updated 7 months ago
- The goal of the OSSCI Fleet is to provide a central mechanism to enable test automation, batch job scheduling, and developer access to a …☆13Apr 28, 2026Updated 6 months ago
- Chakra et_replay is a tool designed for replaying Chakra Execution Traces (ET) from machine learning models using PyTorch.☆14Oct 23, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Manage ML configuration with pydantic☆16Mar 18, 2026Updated 8 months ago
- Learnings + Exercises from the PMPP book!☆11Mar 1, 2026Updated 8 months ago
- Persistent Memory Tool Box☆12Mar 4, 2024Updated 2 years ago
- ☆77Updated this week
- This repository contains the code for our CVPR 2022 paper on "Non-isotropy Regularization for Proxy-based Deep Metric Learning".☆15Mar 10, 2023Updated 3 years ago
- My personal solutions to some textbook problems☆12Feb 12, 2020Updated 6 years ago
- An educational 3D visualization of the DeepSeek-V4.1-Flash model.☆13Sep 10, 2026Updated 2 months ago
- Modded vLLM to run pipeline parallelism over public networks☆42May 20, 2025Updated last year
- Curious whether LLMs can ace the Chinese college entrance exam 高考☆11Jun 28, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- vLLM Quantization plugin for GGUF☆59Nov 11, 2026Updated last week
- ☆12Apr 18, 2019Updated 7 years ago
- ☆16Nov 2, 2022Updated 4 years ago
- ☆18Updated this week
- A Systematic Verification and Structured Revision of Humanity’s Last Exam☆17Feb 27, 2026Updated 8 months ago
- VeriBetrKV OSDI'20 artifact☆13Sep 5, 2020Updated 6 years ago
- 把微软 Edge 的神经网络语音合成能力,包装成 OpenAI TTS API 兼容格式,部署在 Cloudflare Workers 上。免费、快速、无需服务器!☆14Dec 23, 2025Updated 10 months ago
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated last year
- SVIP: Towards Verifiable Inference of Open-Source Large Language Models☆15Jun 3, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Personalized Notion☆18Apr 3, 2026Updated 7 months ago
- From Gradient Leakage to Adversarial Attacks in Federated Learning☆15Sep 21, 2021Updated 5 years ago
- STREAMer: Benchmarking remote volatile and non-volatile memory bandwidth☆18Aug 21, 2023Updated 3 years ago
- Implementation of the Adaptive Resonance Theory (ART) architectures - Fuzzy ART and Fuzzy ARTMAP - for pattern recognition☆11Jan 6, 2019Updated 7 years ago
- deprecated, use https://github.com/octohelm/piper instead.☆14Sep 3, 2024Updated 2 years ago
- Revision of official yolov7-pose to support custom dataset for keypoint detection☆11Nov 12, 2023Updated 3 years ago
- Single file interpreter (or naive virtual machine) for my intermediate representation. SSA support has been added.☆15Apr 27, 2016Updated 10 years ago
Are these results useful?