Evaluate how vLLM and SGLang perform when running a small LLM model on a mid-range NVIDIA GPU
☆21Oct 13, 2026Updated 2 weeks ago
Alternatives and similar repositories for vllm-sglang-perf
Users that are interested in vllm-sglang-perf are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- RWKV Wiki website (archived, please visit official wiki)☆10Mar 26, 2023Updated 3 years ago
- Official repository of paper [FALQON: Accelerating LoRA Fine-tuning with Low-Bit Floating-Point Arithmetic, NeurIPS 2025]☆22Dec 2, 2025Updated 10 months ago
- Reproducibility study of the paper: "InPars Toolkit: A Unified and Reproducible Synthetic Data Generation Pipeline for Neural Information…☆12Feb 11, 2025Updated last year
- This is the public repo for DREAM accepted to ICS 2025.☆12Dec 28, 2025Updated 10 months ago
- 내맘대로 alluxio 정리중☆11May 13, 2019Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆12Aug 2, 2024Updated 2 years ago
- A course on building and sharing AI datasets☆14Oct 14, 2026Updated 2 weeks ago
- Notes on "Data Science from Scratch" by Joel Grus☆11Aug 9, 2016Updated 10 years ago
- A Universal Wallet☆15Dec 14, 2024Updated last year
- C++17 implementation of einops for libtorch - clear and reliable tensor manipulations with einstein-like notation☆12Oct 16, 2023Updated 3 years ago
- ☆15Oct 4, 2024Updated 2 years ago
- Examples of App of Apps Pattern☆10Jan 17, 2023Updated 3 years ago
- [PACT'24] GraNNDis. A fast and unified distributed graph neural network (GNN) training framework for both full-batch (full-graph) and min…☆10Aug 13, 2024Updated 2 years ago
- ☆10Mar 3, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- personal interview prep materials.☆37Oct 1, 2026Updated 3 weeks ago
- The official repository of "LooGLE v2: Are LLMs Ready for Real World Long Dependency Challenges?" (NeurIPS DB Track 2025)☆13Dec 26, 2025Updated 10 months ago
- Implementation for Decision-focused Summarization (EMNLP2021)☆12Mar 14, 2022Updated 4 years ago
- Train large COMET (T5-3B/GPT2-XL) with small memory (on 11GB memory GPUs like 1080/2080) using DeepSpeed.☆14Jan 23, 2022Updated 4 years ago
- Run GitHub Actions on Hugging Face Jobs☆16Oct 7, 2026Updated 3 weeks ago
- LockManager with deadlock detection for implementing 2PL☆14Mar 13, 2019Updated 7 years ago
- Microsoft Azure PaaS 인 WebApp 에 Django 배포☆10Jul 26, 2016Updated 10 years ago
- Quy Nhon AI Hackathon 2022 - Challenge 2: Review Analytics - Top 1 Solution☆11Sep 21, 2022Updated 4 years ago
- [ISCA'25] LIA: A Single-GPU LLM Inference Acceleration with Cooperative AMX-Enabled CPU-GPU Computation and CXL Offloading☆12Jun 28, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- PolyBench/Python is the reimplementation of PolyBench in the Python programming language. It is a benchmark suite of 30 numerical computa…☆10Feb 23, 2021Updated 5 years ago
- GPU kernel optimization framework☆35Updated this week
- Face search engine: 100% recall at 96x less memory than HNSW. Register photos, identify people from camera/video/images. AVX-512 + Rust. …☆20Jul 4, 2026Updated 3 months ago
- This is a clone of an SVN repository at http://pagecache-mangagement.googlecode.com/svn/trunk. It had been cloned by http://svn2github.co…☆10May 23, 2013Updated 13 years ago
- ☆70Dec 29, 2025Updated 10 months ago
- Multi-model fusion chat: a master model synthesizes answers from up to three fusion models. TUI + web UI.☆11Jun 29, 2026Updated 4 months ago
- Training an LSTM network on the Penn Tree Bank (PTB) dataset☆11Nov 5, 2018Updated 7 years ago
- Ask shortgpt for instant and concise answers☆13May 7, 2023Updated 3 years ago
- This is the implementation repository of our OSDI '26 paper: Disentangling Graph Dependencies for Efficient Billion-Scale GPU Vector Sear…☆16Jul 11, 2026Updated 3 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Efficient Knowledge Injection in LLMs via Self-Distillation (TMLR)☆12Aug 5, 2025Updated last year
- AWS Neuron Deep Learning Containers (DLCs) are a set of Docker images for training and serving models on AWS Trainium and Inferentia inst…☆26Oct 22, 2026Updated last week
- vTPM with SGX protection☆12May 30, 2019Updated 7 years ago
- Fixes the rotation of the images based on EXIF data☆15Oct 4, 2026Updated 3 weeks ago
- ODQA Baseline 팀프로젝트 이슈/정보 저장용 레포입니다.☆12May 22, 2021Updated 5 years ago
- Fully chunked KL-Loss kernel, that massively reduces VRAM usage☆20Aug 10, 2026Updated 2 months ago
- Retail Vision Analytics from Computer Vision☆14Mar 20, 2023Updated 3 years ago