A high-throughput and memory-efficient inference and serving engine for LLMs
☆17Nov 1, 2026Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ⚡ Guidance, samples, and tools for HPC workloads on AKS clusters with RDMA and InfiniBand support, including GPUDirect RDMA.☆23Updated this week
- A formally-verified compiler IR☆10May 5, 2026Updated 5 months ago
- ☆10Apr 14, 2026Updated 6 months ago
- ☆12May 8, 2026Updated 5 months ago
- ☆15Jul 10, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆17Dec 19, 2024Updated last year
- Tenstorrent Plugin for Triton☆14Aug 25, 2026Updated 2 months ago
- Nebula: Deep Neural Network Benchmarks in C++☆13Sep 2, 2026Updated 2 months ago
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated last month
- A simple GPU reservation tool for single host shared development systems☆32Aug 24, 2026Updated 2 months ago
- Sequence-level 1F1B schedule for LLMs.☆37Aug 26, 2025Updated last year
- ☆12Oct 16, 2021Updated 5 years ago
- Quick Notebook Tutorials☆36Jul 17, 2025Updated last year
- Python implementation of a proxy DHCP server☆11Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Contrail XML schema code generator☆12May 10, 2021Updated 5 years ago
- ☆17Mar 26, 2025Updated last year
- Evaluate how vLLM and SGLang perform when running a small LLM model on a mid-range NVIDIA GPU☆21Oct 13, 2026Updated 3 weeks ago
- Kubernetes NetworkPolicy for secondary network attachments☆10Updated this week
- VPP Agent written in GO, used by UserSpace CNI to interface with the VPP GO-API.☆13Feb 11, 2020Updated 6 years ago
- Intro to Hyperdimensional Computing (HDC) using a tea dataset☆18Sep 29, 2026Updated last month
- Base Ubuntu image for the ownCloud stack☆11Updated this week
- low and high level python ctype bindings for libnetfilter_{log,queue,conntrack}☆10May 24, 2019Updated 7 years ago
- An open source code of the GitHub Copilot Workspace☆15Jun 8, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The RAFT project integrates Retrieval-Augmented Generation (RAG) with fine-tuning approaches to provide a versatile question-answering sy…☆10Apr 24, 2024Updated 2 years ago
- Resource scheduling and cluster management for AI☆15Jun 29, 2023Updated 3 years ago
- Topology Discovery using LLDP☆10Dec 24, 2015Updated 10 years ago
- Deep contextual bandits in PyTorch: Neural Bandits, Neural Linear, and Linear Full Posterior Sampling with comprehensive benchmarking on …☆12Jun 29, 2025Updated last year
- GPU kernel optimization framework☆36Oct 26, 2026Updated last week
- Kite: Architecture Simulator for RISC-V Instruction Set☆20Mar 22, 2026Updated 7 months ago
- Automate DNS for your (kube) VIPs☆13Aug 29, 2021Updated 5 years ago
- 用golang实现的模拟wap fetion登陆发送短信的库,无需输入验证码☆11May 15, 2013Updated 13 years ago
- Linux Traffic Control (TC) based implementation of Kubernetes NPWG MultiNetworkPolicy API☆12Jul 24, 2026Updated 3 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆20May 24, 2025Updated last year
- ☆13May 21, 2026Updated 5 months ago
- This repository is the project page for "Point Anywhere: Directed Object Estimation from Omnidirectional Images", including source code …☆12Aug 25, 2023Updated 3 years ago
- We put all ready-to-go models here☆21Dec 30, 2022Updated 3 years ago
- Ping test your vpn servers speed and connection the fastest one.☆11Nov 27, 2016Updated 9 years ago
- DNS-based Load Balancer for applications running on Kubernetes clusters☆14May 31, 2024Updated 2 years ago
- Dashboard for InferenceX™, Open Source Continuous Inference | InferenceX 仪表板☆50Updated this week