Evaluate how vLLM and SGLang perform when running a small LLM model on a mid-range NVIDIA GPU
☆20May 31, 2026Updated last month
Alternatives and similar repositories for vllm-sglang-perf
Users that are interested in vllm-sglang-perf are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Python wrapper for the ROUGE summarization evaluation package☆14Aug 9, 2017Updated 8 years ago
- The repository for the paper "Predicting in-hospital mortality by combining clinical notes with time-series data"☆12May 23, 2021Updated 5 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Updated this week
- Nebula: Deep Neural Network Benchmarks in C++☆13Jan 2, 2025Updated last year
- ☆15Oct 4, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Examples of App of Apps Pattern☆10Jan 17, 2023Updated 3 years ago
- LockManager with deadlock detection for implementing 2PL☆13Mar 13, 2019Updated 7 years ago
- Fixes the rotation of the images based on EXIF data☆15Apr 6, 2026Updated 3 months ago
- Implementation for Decision-focused Summarization (EMNLP2021)☆12Mar 14, 2022Updated 4 years ago
- AI-based deep research system☆17Updated this week
- Quy Nhon AI Hackathon 2022 - Challenge 2: Review Analytics - Top 1 Solution☆11Sep 21, 2022Updated 3 years ago
- Enterprise-grade LLMOps platform to accelerate the development and deployment of generative AI applications.☆16Feb 25, 2026Updated 4 months ago
- llm-d helm charts and deployment examples☆59May 1, 2026Updated 2 months ago
- ☆69Dec 29, 2025Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Code release for "TempLM: Distilling Language Models into Template-Based Generators"☆14Jul 21, 2022Updated 4 years ago
- Kite: Architecture Simulator for RISC-V Instruction Set☆21Mar 22, 2026Updated 3 months ago
- vTPM with SGX protection☆12May 30, 2019Updated 7 years ago
- AWS Neuron Deep Learning Containers (DLCs) are a set of Docker images for training and serving models on AWS Trainium and Inferentia inst…☆23Updated this week
- libtpms / swtpm software emulation of a Trusted Platform Module (TPM 1.2 and TPM 2.0) compile script☆13Sep 16, 2020Updated 5 years ago
- ODQA Baseline 팀프로젝트 이슈/정보 저장용 레포입니다.☆12May 22, 2021Updated 5 years ago
- A scikit-learn compliant implementation of Monroe et al.'s Fightin' Words analysis method.☆11May 26, 2026Updated last month
- MULTIOPED: A Corpus of Multi-Perspective News Editorials.☆12Aug 25, 2021Updated 4 years ago
- ☆13Jul 31, 2025Updated 11 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- python script to download & process data to train a speech-synthesis model of Vietnamese M.C. Nguyễn Ngọc Ngạn☆15Aug 13, 2024Updated last year
- Code for the MTEB Arena☆25Jul 2, 2025Updated last year
- Repository containing dataset, models and code associated with the CHIME project☆18Aug 22, 2024Updated last year
- vLLM plugin for HyperCLOVAX☆15Jan 27, 2026Updated 5 months ago
- k8s CSI driver for FastCFS☆13Mar 17, 2024Updated 2 years ago
- Deep Weighted Averaging Classifiers☆22Feb 4, 2019Updated 7 years ago
- Connect to a LSF main node directly or trough a ssh jump node, launch a jupyter notebook via bsub and open automatically a tunnel. The n…☆20Oct 27, 2021Updated 4 years ago
- 인프런, 스프링 웹 MVC 강좌 2부 코드☆12Jan 26, 2019Updated 7 years ago
- An application of Multilayer Perceptron, Random Forest Regression and Recurrent Neural Networks (LSTM)☆14Oct 3, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆24Nov 22, 2022Updated 3 years ago
- Official implementation for the paper, StackEval: Benchmarking LLMs in Coding Assistance, https://arxiv.org/abs/2412.05288☆20Oct 30, 2024Updated last year
- Large Language Model Text Generation Inference on Habana Gaudi☆34Mar 20, 2025Updated last year
- Interact with various LLMs in your browser (LangChain.js, Angular)☆17May 7, 2026Updated 2 months ago
- A Scheduler for Batched LLM Inference☆19Oct 5, 2025Updated 9 months ago
- ☆57Jul 10, 2025Updated last year
- A Test Collection of Computer Science Papers for Faceted Query by Example☆23Nov 28, 2021Updated 4 years ago