bytedance-iaas / vllmView external linksLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆13Oct 10, 2025Updated 4 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- ☆31Apr 19, 2025Updated 9 months ago
- Dockerfile to generate Intellij Idea project shared index☆10Jun 2, 2022Updated 3 years ago
- AdaptiveStep: Automatically Dividing Reasoning Step through Model Confidence☆10Mar 2, 2025Updated 11 months ago
- pip install patchelf. patchelf Python wheel for PyPI.☆11Feb 1, 2026Updated 2 weeks ago
- A conda-smithy repository for ctng-compiler-activation.☆14Feb 5, 2026Updated last week
- Central Point on how to install macOS on Lenovo Ideapad Flex 5 14IIL05 and maybe similar models.☆10May 18, 2023Updated 2 years ago
- Generate PHPUnit tests from annotations, which you can write in your methods documentation☆11Aug 4, 2021Updated 4 years ago
- Integration and automation of NS-3 network simulator and Linux Containers☆12Nov 12, 2019Updated 6 years ago
- 一个移动终端的轻量级前端类库☆17May 24, 2013Updated 12 years ago
- Development containers for triton and triton-cpu☆23Feb 1, 2026Updated 2 weeks ago
- f8app 集成测试覆盖率收集 demo☆10Jun 5, 2017Updated 8 years ago
- This repository contains the results and code for the MLPerf™ Training v3.0 benchmark.☆12Aug 10, 2023Updated 2 years ago
- Terribly incorrect and incomplete AOT compiler for mRuby. Source code for the LLVM Social Berlin #20☆10Aug 25, 2022Updated 3 years ago
- Expert Specialization MoE Solution based on CUTLASS☆27Jan 19, 2026Updated 3 weeks ago
- Fork of LLVM Project containing a Colossus IPU backend implementation☆13Feb 2, 2026Updated 2 weeks ago
- Provides a lot of basic functionality for our algorithms for the Virtual Network Embedding Problem (VNEP).☆12May 3, 2020Updated 5 years ago
- Pytest plugin: add multihost framework.☆11Nov 27, 2025Updated 2 months ago
- Hot-plug devices into a Docker container as they are plugged.☆15Nov 18, 2025Updated 2 months ago
- More Quake. Less bullshit.☆12Apr 26, 2015Updated 10 years ago
- Haidar's Web Page☆13Oct 9, 2024Updated last year
- ET Accelerator Firmware and Runtime☆35Updated this week
- Main Repo for the OpenHW Group Software Task Group☆17Mar 11, 2025Updated 11 months ago
- A conda-smithy repository for jaxlib.☆17Nov 4, 2025Updated 3 months ago
- SGLang is a fast serving framework for large language models and vision language models.☆18Updated this week
- A conda-smithy repository for ctng-compilers.☆15Feb 4, 2026Updated last week
- Systolic Blood Pressure level based on PPG signal's parameteres☆12Jun 4, 2018Updated 7 years ago
- ☆18Oct 29, 2025Updated 3 months ago
- A fuzzer for the CAN bus☆18Mar 1, 2025Updated 11 months ago
- 《Startup Playbook》中文版☆18Jun 24, 2021Updated 4 years ago
- Cerebro plugin to record and fetch list of items on clipboard☆13Aug 8, 2017Updated 8 years ago
- Visual Studio Code GDB Debug Adapter for C and C++ programs.☆14Aug 4, 2023Updated 2 years ago
- 多集群使用thanos sidecar+MinIO监控告警☆15Feb 20, 2023Updated 2 years ago
- ☆17Oct 9, 2024Updated last year
- Python GDB pretty printer using Natvis files for formatting☆15Apr 23, 2020Updated 5 years ago
- LLM training parallelisms (DP, FSDP, TP, PP) in pure C☆26Jan 27, 2026Updated 3 weeks ago
- DLBlas: clean and efficient kernels☆33Updated this week
- ☆11Jan 10, 2025Updated last year
- 🌄 RISC-V Ecosystem Landscape: a living document that developers, investors, vendors, researchers and others can use as a resource on the…☆21Updated this week
- Java library for parsing information from a structured Javadoc string.☆13Nov 4, 2024Updated last year