A high-throughput and memory-efficient inference and serving engine for LLMs
☆31Jul 27, 2026Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆67Updated this week
- Tenstorrent Firmware repository☆24Feb 25, 2026Updated 5 months ago
- Tenstorrent Kernel Module☆70Updated this week
- Tenstorrent Topology (TT-Topology) is a command line utility used to flash multiple NB cards on a system to use specific eth routing conf…☆16Updated this week
- User-Mode Driver for Tenstorrent hardware☆45Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- The Tenstorrent Studio (TT-Studio) is an easy to use web interface for running AI models on Tenstorrent hardware. It handles all the tech…☆49Updated this week
- TT-NN operator library, and TT-Metalium low level kernel programming model.☆1,607Updated this week
- The TT-Forge ONNX is a graph compiler designed to optimize and transform computational graphs for deep learning models, enhancing their p…☆65Updated this week
- Repository for AI model benchmarking on TT-Buda☆16Feb 9, 2026Updated 5 months ago
- Tenstorrent Firmware Update Utility☆14Jun 23, 2026Updated last month
- ☆121Jul 10, 2026Updated 2 weeks ago
- A fast full-system simulator of Tenstorrent hardware☆140Jul 14, 2026Updated 2 weeks ago
- Tenstorrent TT-BUDA Repository☆314Feb 9, 2026Updated 5 months ago
- Tenstorrent console based hardware information program☆62Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A comprehensive tool for visualizing and analyzing model execution, offering interactive graphs, memory plots, tensor details, buffer ove…☆53Updated this week
- Ocelot: The Berkeley Out-of-Order Machine With V-EXT support☆260Updated this week
- Visual Computing Library☆20Jan 14, 2026Updated 6 months ago
- Repository of model demos using TT-Buda☆64Apr 2, 2025Updated last year
- torchtrail: trace the graph of torch functions and modules for visualization, reports, etc☆25May 25, 2025Updated last year
- Japanese Entity Linker.☆12Jul 25, 2021Updated 5 years ago
- 2018 International Student Car Competition: Autonomous Car SKKU Team. HEVEN☆16Mar 9, 2021Updated 5 years ago
- Academic Operating System from Scratch☆14May 2, 2016Updated 10 years ago
- Re-implementation of Bi- (or, Dual-) encoder for Entity Linking. You can run experiments only in 3 seconds.☆11Jun 12, 2023Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A toy programming language which is a subset of OCaml.☆55Updated this week
- JANOG Public Repo☆13Apr 15, 2026Updated 3 months ago
- Tenstorrent's MLIR Based Compiler. We aim to enable developers to run AI on all configurations of Tenstorrent hardware, through an open-s…☆331Updated this week
- RISC-V Directed Test Framework and Compliance Suite, RiESCUE☆69Jul 11, 2026Updated 2 weeks ago
- A low level hardware debugger☆21Updated this week
- This GitHub repo contains the artifact for CPElide, which appears at MICRO '24☆17Sep 7, 2024Updated last year
- ☆23Apr 24, 2026Updated 3 months ago
- System firmware for Tenstorrent hardware☆41Updated this week
- MIPS simulator in C++☆13Oct 2, 2019Updated 6 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- tiny code to access tenstorrent blackhole☆68May 26, 2025Updated last year
- A repository where GPU applications are aggregated using a common build flow that supports multiple CUDA versions.☆94Apr 14, 2026Updated 3 months ago
- ☆25May 18, 2025Updated last year
- 疲労困憊していても書ける優しいプログラミング言語のコンパイラ☆11Dec 25, 2025Updated 7 months ago
- GitHub Actions Self-Hosted runner for RISC-V☆32Oct 12, 2025Updated 9 months ago
- C++ visualizing and tracking library built on the wandb☆33Jun 30, 2024Updated 2 years ago
- the peachili( Peach + Chili) programming language☆11Feb 2, 2021Updated 5 years ago