A high-throughput and memory-efficient inference and serving engine for LLMs
☆21Feb 1, 2026Updated 6 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Estimate the throughput of OAI compatible servers☆21Jul 1, 2026Updated last month
- Guidelines for our secondary layer of annotation adding multi-sentence AMR links☆12Sep 6, 2017Updated 8 years ago
- ☆76Dec 10, 2025Updated 8 months ago
- Data mapping framework for rust stuff☆58Mar 25, 2026Updated 5 months ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Aug 15, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.☆41Updated this week
- From Hero to Zéroe: A Benchmark of Low-Level Adversarial Attacks☆15Feb 23, 2023Updated 3 years ago
- CUDA, CuDNN, NVIDIA Driver, and PyTorch Installation for Ubuntu☆12Feb 27, 2025Updated last year
- Python module to remove wiki markup text.☆10Jan 15, 2016Updated 10 years ago
- A Collection of Pydantic Models to Abstract IRL☆40Dec 10, 2025Updated 8 months ago
- Code for the paper "BPE stays on SCRIPT", "Which Pieces Does Unigram Tokenization Really Need?" and MinGram☆21Updated this week
- High-performance backend for language model probabilistic programs☆17Aug 17, 2026Updated last week
- ☆14Jun 2, 2026Updated 2 months ago
- Real-time terminal monitor for InfiniBand networks - htop for high-speed interconnects☆142Dec 30, 2025Updated 8 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Tooling for exact and MinHash deduplication of large-scale text datasets☆96Mar 24, 2026Updated 5 months ago
- Master thesis: Exploring bias in German NLG (GPT-3 & GerPT-2). Applies regard classification and bias mitigation triggers.☆16Sep 25, 2024Updated last year
- Train and finutune text-to-speech models for Bengali and many other languages!☆18Apr 2, 2025Updated last year
- CTC beam search☆12Oct 26, 2016Updated 9 years ago
- Morphological Inflection for Low-Resource Languages using cross-lingual transfer☆21Jan 17, 2020Updated 6 years ago
- Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"☆22Feb 14, 2024Updated 2 years ago
- Trigram tokenizer module for SQLite FTS5☆14Feb 22, 2021Updated 5 years ago
- The most extensive open massively multilingual corpus of datasets for training sentiment models. The corpus consists of 79 manually selec…☆17Nov 14, 2023Updated 2 years ago
- slowly building a set of infinite riddle generators for data-hungry methods☆14Nov 15, 2022Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A collection of utilities for handling IPA phones.☆27Sep 24, 2023Updated 2 years ago
- fiwGAN/ciwGAN (Featural and Categorical InfoWaveGAN): Generative Adversarial Phonology and Semantics☆29May 24, 2023Updated 3 years ago
- An llm wrapper for OpenAI☆13Dec 14, 2024Updated last year
- Generate a cute welcome message for yourself each day☆22Mar 30, 2023Updated 3 years ago
- Notes for torch maintainers/modders☆10Mar 29, 2016Updated 10 years ago
- Mock of streamlit to allow unit tests☆10Aug 4, 2022Updated 4 years ago
- ☆19Nov 19, 2024Updated last year
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning☆30Jan 25, 2023Updated 3 years ago
- ☆19Feb 22, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆38Apr 29, 2023Updated 3 years ago
- Instant Neural Graphics Primitives from scratch, zero dependencies. Learning by doing.☆10Aug 18, 2023Updated 3 years ago
- TradeBuild Trading Platform version 2.7☆13Feb 24, 2026Updated 6 months ago
- Algorithms for byte-level language modelling☆25May 14, 2026Updated 3 months ago
- Abstraction and Reasoning Corpus☆15Nov 22, 2022Updated 3 years ago
- An experiment to see if chatgpt can improve the output of the stanford alpaca dataset☆12Mar 29, 2023Updated 3 years ago
- Implementation of Production Ready Information Retrieval System☆11May 7, 2023Updated 3 years ago