A high-throughput and memory-efficient inference and serving engine for LLMs
☆30Sep 16, 2026Updated last week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆75Updated this week
- Tenstorrent Topology (TT-Topology) is a command line utility used to flash multiple NB cards on a system to use specific eth routing conf…☆16Jul 23, 2026Updated 2 months ago
- User-Mode Driver for Tenstorrent hardware☆50Updated this week
- The Tenstorrent Studio (TT-Studio) is an easy to use web interface for running AI models on Tenstorrent hardware. It handles all the tech…☆51Updated this week
- TT-NN operator library, and TT-Metalium low level kernel programming model.☆1,688Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- The TT-Forge ONNX is a graph compiler designed to optimize and transform computational graphs for deep learning models, enhancing their p…☆67Updated this week
- Repository for AI model benchmarking on TT-Buda☆15Feb 9, 2026Updated 7 months ago
- Tenstorrent Firmware Update Utility☆14Updated this week
- ☆44Updated this week
- A fast full-system simulator of Tenstorrent hardware☆158Updated this week
- ☆16Jul 24, 2023Updated 3 years ago
- Tenstorrent TT-BUDA Repository☆314Feb 9, 2026Updated 7 months ago
- Tenstorrent console based hardware information program☆66Updated this week
- ☆12Oct 25, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A comprehensive tool for visualizing and analyzing model execution, offering interactive graphs, memory plots, tensor details, buffer ove…☆57Updated this week
- Proxy app for Nek5000☆13Mar 20, 2018Updated 8 years ago
- Ocelot: The Berkeley Out-of-Order Machine With V-EXT support☆263Aug 18, 2026Updated last month
- Repository of model demos using TT-Buda☆63Apr 2, 2025Updated last year
- torchtrail: trace the graph of torch functions and modules for visualization, reports, etc☆25May 25, 2025Updated last year
- 2018 International Student Car Competition: Autonomous Car SKKU Team. HEVEN☆16Mar 9, 2021Updated 5 years ago
- Tenstorrent MLIR compiler☆310Updated this week
- Nebula: Deep Neural Network Benchmarks in C++☆13Sep 2, 2026Updated 3 weeks ago
- Tenstorrent's MLIR Based Compiler. We aim to enable developers to run AI on all configurations of Tenstorrent hardware, through an open-s…☆367Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆26Sep 13, 2026Updated 2 weeks ago
- A low level hardware debugger☆21Updated this week
- KV cache compression via sparse coding☆18Oct 26, 2025Updated 11 months ago
- A lightweight and fast LLM serving framework☆15Mar 5, 2026Updated 6 months ago
- ☆23Apr 24, 2026Updated 5 months ago
- MIPS simulator in C++☆14Oct 2, 2019Updated 6 years ago
- ☆40Mar 14, 2024Updated 2 years ago
- System firmware for Tenstorrent hardware☆45Updated this week
- Frontend integration for PyTorch with tt-mlir☆26Aug 28, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆25May 18, 2025Updated last year
- Plugin for XBMC/Boxee Fancast support☆27Mar 3, 2009Updated 17 years ago
- 疲労困憊していても書ける優しいプログラミング言語のコンパイラ☆11Dec 25, 2025Updated 9 months ago
- GitHub Actions Self-Hosted runner for RISC-V☆32Oct 12, 2025Updated 11 months ago
- Install the tenstorrent stack with one command☆24Sep 7, 2026Updated 2 weeks ago
- the peachili( Peach + Chili) programming language☆11Feb 2, 2021Updated 5 years ago
- ☆34Sep 9, 2020Updated 6 years ago