A high-throughput and memory-efficient inference and serving engine for LLMs
☆10Apr 27, 2026Updated 6 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Phoenix Beginner's Guide☆15Apr 22, 2026Updated 6 months ago
- ☆14May 24, 2026Updated 5 months ago
- Official OpenAPI SDK and Demo repositories must be used in conjunction with the official OpenAPI documentation.☆20Aug 5, 2025Updated last year
- Generate Ecto schemas from existing database in Phoenix - Elixir☆24Sep 23, 2018Updated 8 years ago
- Provides a Python interface to GPU management and monitoring functions. This is a wrapper around the MTML library.☆10Oct 27, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Our guide to the cities where we have offices☆16Sep 24, 2021Updated 5 years ago
- github profile☆23Updated this week
- A C implementation (including tests) of the Jacobi eigenvalue algorithm, that is meant to be easily understandable.☆10Jul 1, 2023Updated 3 years ago
- Automatic python3 script to exploit CSE BookStore v1.0☆14Jun 16, 2021Updated 5 years ago
- This repository contains sensor code and network examples for pico-w☆15Aug 12, 2024Updated 2 years ago
- application to test personality using python and django.☆14Mar 22, 2025Updated last year
- a collection of CUDA Kernels☆18Jul 24, 2026Updated 3 months ago
- ☆18Oct 25, 2026Updated last week
- Work with Pi☆15Feb 9, 2026Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆29Aug 17, 2018Updated 8 years ago
- ☆15Dec 5, 2025Updated 11 months ago
- Implementation of Lyre-LM: finetuning LLMs for lyric generation (llama-2-7b).☆11Dec 13, 2023Updated 2 years ago
- Prompt Assembly Language - A framework for developing LLM prompts as versioned, composable software artifacts☆21Aug 16, 2026Updated 2 months ago
- A collection of software tools to aid myself (and optionally others) in improved agentic ai development☆12Nov 4, 2025Updated last year
- Repository for GPU related kernels for learning/testing purposes☆21May 27, 2026Updated 5 months ago
- AI agent toolkit: coding agent CLI, unified LLM API, TUI & web UI libraries, Slack bot, vLLM pods☆12Mar 3, 2026Updated 8 months ago
- writing really fast kernels☆24Updated this week
- Deep learning model to detect lung cancer & classify between 4 types of tumors. 4x Hackathon Winner☆20Oct 27, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Implementing Face Beautification: Beyond Makeup Transfer (https://www.catalyzex.com/paper/arxiv:1912.03630)☆13May 6, 2020Updated 6 years ago
- ☆32Updated this week
- A from-scratch GPU stack: custom SIMT hardware in Verilog → a 16-bit ISA + assembler → J++, a small C-like language and compiler — all ru…☆28Sep 29, 2026Updated last month
- UI toolkit to ease BoxyHQ integration☆17Oct 9, 2026Updated 3 weeks ago
- Mixed-precision numerics benchmarks in Rust and Python - covering GEMMs, SYRKs, DOTs, and higher-level BLAS and LAPACK-style functionalit…☆34Oct 28, 2026Updated last week
- A simple C compiler I wrote to demonstrate how to write simple compilers. Currently targets x86_64☆31Jun 27, 2025Updated last year
- AI agent toolkit: coding agent CLI, unified LLM API, TUI & web UI libraries, Slack bot, vLLM pods☆11Mar 17, 2026Updated 7 months ago
- Tape-style context management for pi, inspired by tape.systems☆13Updated this week
- Official Code for NeurIPS 2022 Paper: How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders☆69Nov 17, 2023Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A quiet native macOS menu bar timer with a thin progress line.☆14Sep 24, 2026Updated last month
- Deep Continuous Quantile Regression and other experiments.☆13Feb 24, 2020Updated 6 years ago
- Kinde documentation☆14Updated this week
- Optimization of PV and Battery Energy Storage System☆14Oct 15, 2023Updated 3 years ago
- Intelligent task routing for multi-agent systems☆17Feb 24, 2026Updated 8 months ago
- A repository for the survey of Conversational Search.☆14Oct 2, 2025Updated last year
- ☆17Sep 21, 2026Updated last month