A high-throughput and memory-efficient inference and serving engine for LLMs
☆32Jul 21, 2026Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆21Jun 13, 2026Updated last month
- ☆15Updated this week
- Official code for paper "Revisiting Model Interpolation for Efficient Reasoning"☆17Jul 14, 2026Updated last week
- ☆15May 24, 2021Updated 5 years ago
- Simulates a logged in user.☆16Jul 10, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆21Sep 27, 2023Updated 2 years ago
- Unified KV cache compression for LLM inference — TurboQuant, IsoQuant, PlanarQuant, TriAttention. 10 methods, GPU-validated, multi-GPU pl…☆24Jul 11, 2026Updated last week
- GBM multicore scaling: h2o, xgboost and lightgbm on multicore and multi-socket systems☆20May 13, 2018Updated 8 years ago
- vLLM fork with Marlin W4A8 SM121 patches + TMA module☆16Mar 23, 2026Updated 3 months ago
- © 哨兵博客 V3 Power by Bin4xin | Jekyll | Github Action.☆11Updated this week
- An eclipse plugin for covert the encoding of files.☆19Mar 25, 2016Updated 10 years ago
- DeepSeek-V4-Flash on Ampere SM 8.6 via vLLM (pyref kernel replacements)☆26Jul 2, 2026Updated 2 weeks ago
- Dockerfiles for poetry/mlc-llm(rk3588)/...☆10Sep 13, 2023Updated 2 years ago
- VDM sig bypass and additional WinAPI stubs☆19Feb 16, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- PydanticAI开源框架，搭建基于PostgreSQL、MySQL的Text2SQL应用进行SQL语句生成，支持GPT大模型、国产大模型、开源本地大模型☆17Dec 26, 2024Updated last year
- PyTorch implementation of GNN models☆23Jul 11, 2025Updated last year
- 一款被动扫描ssrf的burpsuite插件☆20Dec 30, 2022Updated 3 years ago
- ☆22Sep 27, 2023Updated 2 years ago
- ☆16May 7, 2025Updated last year
- RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink☆664Updated this week
- pairwise learning to rank with logistic regression☆20Apr 24, 2016Updated 10 years ago
- Erebus is a payload generator written in Nim.☆18Jun 13, 2023Updated 3 years ago
- A compute framework for building Search, RAG, Recommendations and Analytics over complex (structured+unstructured) data, with ultra-modal…☆12Sep 16, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Country flag FieldFormat Plugin for Kibana 7☆18Oct 23, 2020Updated 5 years ago
- Kubeflow on OpenShift☆14Jan 24, 2019Updated 7 years ago
- Some benchmark results of small models and quants that fit on DGX Spark☆48Updated this week
- 一款根据pom.xml获取引用的第三方组件的版本号并识别组件漏洞的工具☆23May 17, 2023Updated 3 years ago
- Experimentation on google's gemma model☆15Mar 6, 2024Updated 2 years ago
- This repo consists of code for plotting top loss images☆13May 18, 2020Updated 6 years ago
- Docker configuration for running VLLM on dual DGX Sparks☆1,867Updated this week
- Implementation of <Model Merging with Functional Dual Anchors>☆46Nov 23, 2025Updated 7 months ago
- A packer which adds encrypted shell to protect your PE file☆29Nov 16, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This repository hosts community contributed Kestrel analytics☆19May 28, 2024Updated 2 years ago
- 对任意http网站添加指定漏洞 目前实现部分漏洞的追加 支持本身http服务 支持反向代理追加☆28Oct 8, 2022Updated 3 years ago
- ☆12Jun 17, 2023Updated 3 years ago
- Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parall…☆97Updated this week
- It gives you a step by step approach to predict binary data using linear regression.☆11Feb 28, 2021Updated 5 years ago
- Use requests to send HTTP raw sockets (To Test RFC Compliance)☆24Jun 22, 2024Updated 2 years ago
- Python Agent is a Python application probe of DongTai IAST, which collects method invocation data during runtime of Python application by…☆22Jun 6, 2022Updated 4 years ago