A high-throughput and memory-efficient inference and serving engine for LLMs
☆14Aug 7, 2026Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Expert Specialization MoE Solution based on CUTLASS☆27Apr 14, 2026Updated 3 months ago
- ☆19Jan 27, 2021Updated 5 years ago
- AdaptiveStep: Automatically Dividing Reasoning Step through Model Confidence☆10Mar 2, 2025Updated last year
- This repository contains the results and code for the MLPerf™ Training v3.0 benchmark.☆12Aug 10, 2023Updated 3 years ago
- This is a repo with a Triton Server deployment template☆24Aug 4, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- BERT NER of pytorch editon, including ERNIE implementation.☆11Aug 28, 2019Updated 6 years ago
- Dockerfile to generate Intellij Idea project shared index☆10Jun 2, 2022Updated 4 years ago
- SGLang is a fast serving framework for large language models and vision language models.☆31Updated this week
- 这是 一个王道培训的C++文档,包含了课程中的每次作业提交项目,项目中有.md文件作为详细说明.☆13Oct 9, 2019Updated 6 years ago
- 一个基于官方API的QQ群聊机器人☆22Nov 27, 2025Updated 8 months ago
- 🦀 Mobile-first AI agent framework. Your butler, in your pocket. OpenClaw alternative for 6.8B phone users.☆33Mar 17, 2026Updated 4 months ago
- Rust framework for building high-performance network services☆66Aug 29, 2025Updated 11 months ago
- Integration and automation of NS-3 network simulator and Linux Containers☆12Nov 12, 2019Updated 6 years ago
- Code for the paper: Dense Reward for Free in Reinforcement Learning from Human Feedback (ICML 2024) by Alex J. Chan, Hao Sun, Samuel Holt…☆38Aug 11, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Open source skill library for AI coding agents to write, optimize, and debug high performance compute kernels across CUDA, Triton, and qu…☆54Jun 21, 2026Updated last month
- ☆33Apr 19, 2025Updated last year
- Generate PHPUnit tests from annotations, which you can write in your methods documentation☆11Aug 4, 2021Updated 5 years ago
- ☆35Jul 19, 2021Updated 5 years ago
- Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044☆36Oct 3, 2024Updated last year
- Official Implementation of ConceptLM.☆23Mar 18, 2026Updated 4 months ago
- Central Point on how to install macOS on Lenovo Ideapad Flex 5 14IIL05 and maybe similar models.☆11May 18, 2023Updated 3 years ago
- Cerebro plugin to record and fetch list of items on clipboard☆13Aug 8, 2017Updated 9 years ago
- Provides a lot of basic functionality for our algorithms for the Virtual Network Embedding Problem (VNEP).☆12May 3, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- f8app 集成测试覆盖率收集 demo☆10Jun 5, 2017Updated 9 years ago
- ☆13Apr 28, 2017Updated 9 years ago
- A fuzzer for the CAN bus☆18Mar 1, 2025Updated last year
- 一个移动终端的轻量级前端类库☆17May 24, 2013Updated 13 years ago
- Python implementation of Discovery V5 Protocol☆19Mar 1, 2022Updated 4 years ago
- sql☆44Feb 4, 2016Updated 10 years ago
- Reproducing Quantization paper PACT☆66Jul 8, 2022Updated 4 years ago
- 多集群使用thanos sidecar+MinIO监控告警☆15Feb 20, 2023Updated 3 years ago
- A curated list of amazingly awesome JPHP libraries, resources and shiny things.☆18Feb 27, 2020Updated 6 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- The official implementation of "LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation"☆22Apr 22, 2025Updated last year
- [POC] Rootless Containers without `/etc/subuid` and `/etc/subgid`☆20Oct 16, 2020Updated 5 years ago
- Sprite tool that output sprite images and stylesheet files base on configured images, supports rem☆16Sep 11, 2016Updated 9 years ago
- 热部署插件HotSecondsServer的一个扩展包，实现对各种第三方框架的热更新，持续更新中 .....☆18Jul 10, 2024Updated 2 years ago
- Uni-RLHF platform for "Uni-RLHF: Universal Platform and Benchmark Suite for Reinforcement Learning with Diverse Human Feedback" (ICLR2024…☆42Nov 20, 2024Updated last year
- Transformer related optimization, including BERT, GPT☆17Jul 29, 2023Updated 3 years ago
- Java library for parsing information from a structured Javadoc string.☆14Nov 4, 2024Updated last year