☆14Dec 22, 2023Updated 2 years ago
Alternatives and similar repositories for runpod-vllm
Users that are interested in runpod-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Updated this week
- ☆40Aug 31, 2026Updated 3 weeks ago
- Inference Llama 2 in one file of pure Haskell (A port of llama2.c from Andrej Karpathy)☆14Oct 17, 2025Updated 11 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆11Sep 4, 2025Updated last year
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust