Evaluate how vLLM and SGLang perform when running a small LLM model on a mid-range NVIDIA GPU
☆21May 31, 2026Updated 2 months ago
Alternatives and similar repositories for vllm-sglang-perf
Users that are interested in vllm-sglang-perf are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Aug 14, 2026Updated 2 weeks ago
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆18Dec 19, 2024Updated last year
- 내맘대로 alluxio 정리중☆11May 13, 2019Updated 7 years ago
- The repository for the paper "Predicting in-hospital mortality by combining clinical notes with time-series data"☆12May 23, 2021Updated 5 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Prompt format and padding guide for Llama 2☆12Sep 18, 2023Updated 2 years ago
- StartupHeroes Checkstyle project with additional Checkstyle checks and Sonar Checkstyle plugin☆10Jan 25, 2024Updated 2 years ago
- C++17 implementation of einops for libtorch - clear and reliable tensor manipulations with einstein-like notation☆12Oct 16, 2023Updated 2 years ago
- ☆15Oct 4, 2024Updated last year
- [ISCA'25] LIA: A Single-GPU LLM Inference Acceleration with Cooperative AMX-Enabled CPU-GPU Computation and CXL Offloading☆12Jun 28, 2025Updated last year
- Examples of App of Apps Pattern☆10Jan 17, 2023Updated 3 years ago
- LockManager with deadlock detection for implementing 2PL☆13Mar 13, 2019Updated 7 years ago
- PolyBench/Python is the reimplementation of PolyBench in the Python programming language. It is a benchmark suite of 30 numerical computa…☆10Feb 23, 2021Updated 5 years ago
- Notes on "Data Science from Scratch" by Joel Grus☆11Aug 9, 2016Updated 10 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆10Mar 3, 2024Updated 2 years ago
- Train large COMET (T5-3B/GPT2-XL) with small memory (on 11GB memory GPUs like 1080/2080) using DeepSpeed.☆14Jan 23, 2022Updated 4 years ago
- AI-based deep research system☆17Jul 15, 2026Updated last month
- This is a clone of an SVN repository at http://pagecache-mangagement.googlecode.com/svn/trunk. It had been cloned by http://svn2github.co…☆10May 23, 2013Updated 13 years ago
- [DATE 2023] Pipe-BD: Pipelined Parallel Blockwise Distillation☆12Jul 13, 2023Updated 3 years ago
- Enterprise-grade LLMOps platform to accelerate the development and deployment of generative AI applications.☆17Feb 25, 2026Updated 6 months ago
- llm-d helm charts and deployment examples☆59May 1, 2026Updated 3 months ago
- Code release for "TempLM: Distilling Language Models into Template-Based Generators"☆14Jul 21, 2022Updated 4 years ago
- RPCNIC: A High-Performance and Reconfigurable PCIe-attached RPC Accelerator [HPCA2025]☆16Dec 9, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- GenStore is the first in-storage processing system designed for genome sequence analysis that greatly reduces both data movement and comp…☆15Apr 6, 2022Updated 4 years ago
- GGUF parser in Python☆28May 1, 2026Updated 3 months ago
- Training an LSTM network on the Penn Tree Bank (PTB) dataset☆11Nov 5, 2018Updated 7 years ago
- ☆16Jun 4, 2024Updated 2 years ago
- libtpms / swtpm software emulation of a Trusted Platform Module (TPM 1.2 and TPM 2.0) compile script☆13Sep 16, 2020Updated 5 years ago
- A scikit-learn compliant implementation of Monroe et al.'s Fightin' Words analysis method.☆11May 26, 2026Updated 3 months ago
- Course information for CSCI 5622 in Fall 2019☆22Nov 21, 2019Updated 6 years ago
- This is the code repository for our work on resourcing-on-demand GPU provisioning for serverless deep learning serving.☆17Apr 17, 2026Updated 4 months ago
- ☆15Nov 7, 2025Updated 9 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Web GUI to Monitor and control ROS enabled Robots based on work represented in the book : ROS BY EXAMPLE. Copyright © 2012 by R. Patrick …☆17Jul 11, 2019Updated 7 years ago
- Source code for Learn Locally Correct Globally☆14Nov 15, 2021Updated 4 years ago
- Repository containing dataset, models and code associated with the CHIME project☆18Aug 22, 2024Updated 2 years ago
- ☆16Sep 25, 2025Updated 11 months ago
- k8s CSI driver for FastCFS☆13Mar 17, 2024Updated 2 years ago
- Deep Weighted Averaging Classifiers☆22Feb 4, 2019Updated 7 years ago
- 인프런, 스프링 웹 MVC 강좌 2부 코드☆12Jan 26, 2019Updated 7 years ago