☆14Sep 29, 2026Updated 2 weeks ago
Alternatives and similar repositories for runpod-vllm
Users that are interested in runpod-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Updated this week
- ☆45Aug 31, 2026Updated last month
- Inference Llama 2 in one file of pure Haskell (A port of llama2.c from Andrej Karpathy)☆14Oct 17, 2025Updated 11 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆11Sep 4, 2025Updated last year
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust