A high-throughput and memory-efficient inference and serving engine for LLMs
☆21Feb 1, 2026Updated 6 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code accompanying the paper "A Language Model's Guide Through Latent Space". It contains functionality for training and using concept vec…☆21Feb 23, 2024Updated 2 years ago
- Estimate the throughput of OAI compatible servers☆21Jul 1, 2026Updated last month
- Guidelines for our secondary layer of annotation adding multi-sentence AMR links☆12Sep 6, 2017Updated 8 years ago
- Ukrainian ELECTRA model☆12Mar 11, 2023Updated 3 years ago
- Data mapping framework for rust stuff☆56Mar 25, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆33Apr 8, 2026Updated 4 months ago
- Official repository for the paper "Question Answering Infused Pre-training of General-Purpose Contextualized Representations" by Robin Ji…☆16Aug 13, 2021Updated 4 years ago
- Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.☆41Updated this week
- From Hero to Zéroe: A Benchmark of Low-Level Adversarial Attacks☆15Feb 23, 2023Updated 3 years ago
- CUDA, CuDNN, NVIDIA Driver, and PyTorch Installation for Ubuntu☆12Feb 27, 2025Updated last year
- It's a cooler way to store simple linear models.☆26Jul 15, 2024Updated 2 years ago
- A Collection of Pydantic Models to Abstract IRL☆40Dec 10, 2025Updated 8 months ago
- High-performance backend for language model probabilistic programs☆17Updated this week
- Repository for "Self-Distillation for Model Stacking Unlocks Cross-Lingual NLU in 200+ Languages"☆15Oct 4, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆14Jun 2, 2026Updated 2 months ago
- Tooling for exact and MinHash deduplication of large-scale text datasets☆93Mar 24, 2026Updated 4 months ago
- Master thesis: Exploring bias in German NLG (GPT-3 & GerPT-2). Applies regard classification and bias mitigation triggers.☆16Sep 25, 2024Updated last year
- Train and finutune text-to-speech models for Bengali and many other languages!☆18Apr 2, 2025Updated last year
- Dense Article Dataset (DAD): A Benchmark Dataset for Document Layout Analysis☆16Jan 13, 2022Updated 4 years ago
- Align, a general text alignment function☆15Dec 7, 2023Updated 2 years ago
- M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer☆54Nov 21, 2022Updated 3 years ago
- Rust binding to crfsuite☆25Jan 31, 2026Updated 6 months ago
- CLI and library for translating OTP (One-time-password) archives between different OTP apps.☆22Sep 29, 2025Updated 10 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A collection of utilities for handling IPA phones.☆27Sep 24, 2023Updated 2 years ago
- Shortest versions of python script for image processing with OpenCV☆13Jun 16, 2022Updated 4 years ago
- An llm wrapper for OpenAI☆13Dec 14, 2024Updated last year
- ☆13Apr 16, 2025Updated last year
- .NET bindings for the Pytorch engine☆17Oct 26, 2019Updated 6 years ago
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning☆30Jan 25, 2023Updated 3 years ago
- ☆19Nov 30, 2024Updated last year
- LlamaCon Hackathon 2025 SF☆12May 5, 2025Updated last year
- ☆19Feb 22, 2026Updated 5 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Deep reinforcement learning package for torch7☆16Sep 17, 2016Updated 9 years ago
- Instant Neural Graphics Primitives from scratch, zero dependencies. Learning by doing.☆10Aug 18, 2023Updated 2 years ago
- Algorithms for byte-level language modelling☆25May 14, 2026Updated 2 months ago
- Abstraction and Reasoning Corpus☆15Nov 22, 2022Updated 3 years ago
- An experiment to see if chatgpt can improve the output of the stanford alpaca dataset☆12Mar 29, 2023Updated 3 years ago
- LR0.FM: Low-Resolution Zero-shot Classification Benchmark For Foundation Models☆16Aug 29, 2025Updated 11 months ago
- ☆15Apr 9, 2025Updated last year