A high-throughput and memory-efficient inference and serving engine for LLMs
☆21Feb 1, 2026Updated 5 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code accompanying the paper "A Language Model's Guide Through Latent Space". It contains functionality for training and using concept vec…☆21Feb 23, 2024Updated 2 years ago
- Estimate the throughput of OAI compatible servers☆21Jul 1, 2026Updated 2 weeks ago
- JavaScript virtual machine for WebAssembly and Taint Tracking security tool☆15Dec 15, 2017Updated 8 years ago
- Ukrainian ELECTRA model☆12Mar 11, 2023Updated 3 years ago
- Code for "Threat Scenarios and Best Practices for Neural Fake News Detection: A Case Study on COVID"☆10Nov 19, 2022Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆66Dec 10, 2025Updated 7 months ago
- Data mapping framework for rust stuff☆56Mar 25, 2026Updated 3 months ago
- Thin wrapper for the AllenNLP's implementation of supervised open information extraction☆17Nov 19, 2019Updated 6 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Aug 15, 2023Updated 2 years ago
- Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.☆42Updated this week
- Align, a general text alignment function☆15Dec 7, 2023Updated 2 years ago
- CUDA, CuDNN, NVIDIA Driver, and PyTorch Installation for Ubuntu☆12Feb 27, 2025Updated last year
- It's a cooler way to store simple linear models.☆26Jul 15, 2024Updated 2 years ago
- A Collection of Pydantic Models to Abstract IRL☆41Dec 10, 2025Updated 7 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Official code and dataset for our NAACL 2024 paper: DialogCC: An Automated Pipeline for Creating High-Quality Multi-modal Dialogue Datase…☆13Jun 24, 2024Updated 2 years ago
- Code for the paper "BPE stays on SCRIPT", "Which Pieces Does Unigram Tokenization Really Need?" and MinGram☆18Jun 26, 2026Updated 3 weeks ago
- High-performance backend for language model probabilistic programs☆17Jun 29, 2026Updated 3 weeks ago
- ☆14Jun 2, 2026Updated last month
- Repository for "Self-Distillation for Model Stacking Unlocks Cross-Lingual NLU in 200+ Languages"☆15Oct 4, 2024Updated last year
- Tooling for exact and MinHash deduplication of large-scale text datasets☆90Mar 24, 2026Updated 3 months ago
- Master thesis: Exploring bias in German NLG (GPT-3 & GerPT-2). Applies regard classification and bias mitigation triggers.☆16Sep 25, 2024Updated last year
- Train and finutune text-to-speech models for Bengali and many other languages!☆18Apr 2, 2025Updated last year
- Dense Article Dataset (DAD): A Benchmark Dataset for Document Layout Analysis☆16Jan 13, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- CTC beam search☆12Oct 26, 2016Updated 9 years ago
- Learning Formal Mathematics from Intrinsic Motivation☆36Jul 10, 2025Updated last year
- Code for Focusnet (ISBI2019) and FocusnetAlpha☆12Apr 24, 2020Updated 6 years ago
- M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer☆54Nov 21, 2022Updated 3 years ago
- Scaling Sparse Fine-Tuning to Large Language Models☆19Jan 31, 2024Updated 2 years ago
- ☆14May 21, 2021Updated 5 years ago
- Rust binding to crfsuite☆25Jan 31, 2026Updated 5 months ago
- CLI and library for translating OTP (One-time-password) archives between different OTP apps.☆22Sep 29, 2025Updated 9 months ago
- The most extensive open massively multilingual corpus of datasets for training sentiment models. The corpus consists of 79 manually selec…☆16Nov 14, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Shortest versions of python script for image processing with OpenCV☆13Jun 16, 2022Updated 4 years ago
- An llm wrapper for OpenAI☆13Dec 14, 2024Updated last year
- Generate a cute welcome message for yourself each day☆22Mar 30, 2023Updated 3 years ago
- Notes for torch maintainers/modders☆10Mar 29, 2016Updated 10 years ago
- Mock of streamlit to allow unit tests☆10Aug 4, 2022Updated 3 years ago
- Trained PyTorch models for polish language sentiment prediction based on allegro/herbert and CLARIN-PL datasets☆11Nov 23, 2021Updated 4 years ago
- A GitHub Action that enables easier conditional matrix builds!☆24Feb 2, 2026Updated 5 months ago