A high-throughput and memory-efficient inference and serving engine for LLMs
☆21Feb 1, 2026Updated 7 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code accompanying the paper "A Language Model's Guide Through Latent Space". It contains functionality for training and using concept vec…☆22Feb 23, 2024Updated 2 years ago
- Ukrainian ELECTRA model☆12Mar 11, 2023Updated 3 years ago
- ☆76Dec 10, 2025Updated 9 months ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Aug 15, 2023Updated 3 years ago
- A library for language transfer methods and algorithms.☆16Feb 6, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.☆41Updated this week
- From Hero to Zéroe: A Benchmark of Low-Level Adversarial Attacks☆15Feb 23, 2023Updated 3 years ago
- CUDA, CuDNN, NVIDIA Driver, and PyTorch Installation for Ubuntu☆12Feb 27, 2025Updated last year
- Python module to remove wiki markup text.☆10Jan 15, 2016Updated 10 years ago
- It's a cooler way to store simple linear models.☆26Jul 15, 2024Updated 2 years ago
- A Collection of Pydantic Models to Abstract IRL☆40Dec 10, 2025Updated 9 months ago
- Code for the paper "BPE stays on SCRIPT", "Which Pieces Does Unigram Tokenization Really Need?" and MinGram☆22Updated this week
- High-performance backend for language model probabilistic programs☆17Updated this week
- Repository for "Self-Distillation for Model Stacking Unlocks Cross-Lingual NLU in 200+ Languages"☆15Oct 4, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆15Jun 2, 2026Updated 3 months ago
- Real-time terminal monitor for InfiniBand networks - htop for high-speed interconnects☆142Sep 3, 2026Updated 2 weeks ago
- Tooling for exact and MinHash deduplication of large-scale text datasets☆96Mar 24, 2026Updated 5 months ago
- Train and finutune text-to-speech models for Bengali and many other languages!☆18Apr 2, 2025Updated last year
- Dense Article Dataset (DAD): A Benchmark Dataset for Document Layout Analysis☆16Jan 13, 2022Updated 4 years ago
- Align, a general text alignment function☆15Dec 7, 2023Updated 2 years ago
- Learning Formal Mathematics from Intrinsic Motivation☆36Jul 10, 2025Updated last year
- Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"☆22Feb 14, 2024Updated 2 years ago
- Trigram tokenizer module for SQLite FTS5☆14Feb 22, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- mamba2-jax: A pure JAX/Flax implementation of Mamba-2 for language modeling and time series forecasting.☆18Jun 23, 2026Updated 2 months ago
- CLI and library for translating OTP (One-time-password) archives between different OTP apps.☆22Sep 29, 2025Updated 11 months ago
- A collection of utilities for handling IPA phones.☆27Sep 24, 2023Updated 2 years ago
- Shortest versions of python script for image processing with OpenCV☆13Jun 16, 2022Updated 4 years ago
- An llm wrapper for OpenAI☆13Dec 14, 2024Updated last year
- Generate a cute welcome message for yourself each day☆22Mar 30, 2023Updated 3 years ago
- A JupyterLab extension for rendering 3d files (stl, amf, obj, 3mf, gcode, collada)☆13Mar 14, 2023Updated 3 years ago
- Mock of streamlit to allow unit tests☆10Aug 4, 2022Updated 4 years ago
- ☆19Nov 19, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A GitHub Action that enables easier conditional matrix builds!☆24Feb 2, 2026Updated 7 months ago
- ☆10Dec 19, 2024Updated last year
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning☆30Jan 25, 2023Updated 3 years ago
- ☆19Nov 30, 2024Updated last year
- ☆24Feb 22, 2026Updated 6 months ago
- Reactive Nix: Enabling Functional Reactive Configuration with mgmt☆15Feb 1, 2026Updated 7 months ago
- Deep reinforcement learning package for torch7☆16Sep 17, 2016Updated 10 years ago