A high-throughput and memory-efficient inference and serving engine for LLMs
☆21Feb 1, 2026Updated 9 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code accompanying the paper "A Language Model's Guide Through Latent Space". It contains functionality for training and using concept vec…☆22Feb 23, 2024Updated 2 years ago
- Estimate the throughput of OAI compatible servers☆22Oct 14, 2026Updated last month
- Guidelines for our secondary layer of annotation adding multi-sentence AMR links☆12Sep 6, 2017Updated 9 years ago
- Code for "Threat Scenarios and Best Practices for Neural Fake News Detection: A Case Study on COVID"☆10Nov 19, 2022Updated 4 years ago
- Ukrainian ELECTRA model☆12Mar 11, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Data mapping framework for rust stuff☆61Mar 25, 2026Updated 7 months ago
- Thin wrapper for the AllenNLP's implementation of supervised open information extraction☆17Nov 19, 2019Updated 7 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Aug 15, 2023Updated 3 years ago
- From Hero to Zéroe: A Benchmark of Low-Level Adversarial Attacks☆15Feb 23, 2023Updated 3 years ago
- IWNLP: A parser for the German edition of Wiktionary☆13Jul 28, 2023Updated 3 years ago
- Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.☆47Updated this week
- Code for Retrofitting Large Language Models with Dynamic Tokenization.☆14Jul 22, 2025Updated last year
- Code repo for paper: Are Large Language Models Reliable AI Scientists? Assessing Reverse-Engineering of Black-Box Systems☆12May 29, 2025Updated last year
- High-performance backend for language model probabilistic programs☆17Oct 14, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- CUDA, CuDNN, NVIDIA Driver, and PyTorch Installation for Ubuntu☆12Feb 27, 2025Updated last year
- A sample pattern for running CI tests on Modal☆21Apr 12, 2025Updated last year
- A Collection of Pydantic Models to Abstract IRL☆40Dec 10, 2025Updated 11 months ago
- Repository for "Self-Distillation for Model Stacking Unlocks Cross-Lingual NLU in 200+ Languages"☆15Oct 4, 2024Updated 2 years ago
- Knowledge Base is important [Accepted in NeurIPS 2024]☆12Nov 1, 2025Updated last year
- Code for the paper "BPE stays on SCRIPT", "Which Pieces Does Unigram Tokenization Really Need?" and MinGram☆22Nov 5, 2026Updated 2 weeks ago
- Real-time terminal monitor for InfiniBand networks - htop for high-speed interconnects☆143Sep 3, 2026Updated 2 months ago
- Master thesis: Exploring bias in German NLG (GPT-3 & GerPT-2). Applies regard classification and bias mitigation triggers.☆16Sep 25, 2024Updated 2 years ago
- [Computer Speech & Language] A transformer-based spelling error correction framework for Bangla and resource scarce Indic languages☆14Sep 12, 2026Updated 2 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Scaling Sparse Fine-Tuning to Large Language Models☆20Jan 31, 2024Updated 2 years ago
- Tooling for exact and MinHash deduplication of large-scale text datasets☆99Nov 7, 2026Updated last week
- Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"☆22Feb 14, 2024Updated 2 years ago
- The Tensorflow implementation of SEENet (BMVC2019)☆11Mar 6, 2020Updated 6 years ago
- M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer☆56Nov 21, 2022Updated 3 years ago
- Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…☆66Nov 18, 2025Updated last year
- OpenArm integration for mjlab☆12Nov 1, 2026Updated 2 weeks ago
- Faster Pi0-FAST inference time; DCT early stopping trick implementation for FAST (Frequency-Space Action Sequence Tokenization)☆13Jun 6, 2025Updated last year
- A format for data collected with OpenArm☆11Nov 4, 2026Updated 2 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Notes for torch maintainers/modders☆10Mar 29, 2016Updated 10 years ago
- Trigram tokenizer module for SQLite FTS5☆14Feb 22, 2021Updated 5 years ago
- A resource for awesome educational resources on Polkadot and Web3☆11Aug 29, 2025Updated last year
- Implementation of Production Ready Information Retrieval System☆11May 7, 2023Updated 3 years ago
- .NET bindings for the Pytorch engine☆17Oct 26, 2019Updated 7 years ago
- Baseline agents for the leaderboard☆11May 2, 2023Updated 3 years ago
- mamba2-jax: A pure JAX/Flax implementation of Mamba-2 for language modeling and time series forecasting.☆19Jun 23, 2026Updated 4 months ago
Are these results useful?