Experimental projects related to TensorRT
☆128Jul 2, 2026Updated 4 months ago
Alternatives and similar repositories for TensorRT-Incubator
Users that are interested in TensorRT-Incubator are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TensorRT Plugin Autogen Tool☆365Apr 7, 2023Updated 3 years ago
- Tensor Compute Primitives: Mid-level Intermediate Representation for Machine Learning Programs☆35Jan 30, 2025Updated last year
- A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")☆409May 31, 2026Updated 5 months ago
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆5,635Updated this week
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆65Apr 26, 2025Updated last year
- a size profiler for cuda binary☆74Oct 3, 2026Updated last month
- 🎉My Collections of CUDA Kernels~☆11Jun 25, 2024Updated 2 years ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆3,019Updated this week
- Shared Middle-Layer for Triton Compilation☆347Oct 15, 2026Updated last month
- ☆48Mar 5, 2024Updated 2 years ago
- [WIP] Better (FP8) attention for Hopper☆33Aug 21, 2026Updated 2 months ago
- Ditto is an open-source framework that enables direct conversion of HuggingFace PreTrainedModels into TensorRT-LLM engines.☆56Jul 16, 2025Updated last year
- ☆16Sep 24, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The Triton TensorRT-LLM Backend☆944Nov 2, 2026Updated 2 weeks ago
- vLLM plugin for RBLN NPU☆61Updated this week
- ☆27Feb 20, 2024Updated 2 years ago
- High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI☆633Updated this week
- Triton Compiler related materials.☆46Mar 16, 2026Updated 8 months ago
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆193Jan 28, 2025Updated last year
- Mirage Persistent Kernel: Compiling LLMs into a MegaKernel☆2,623Updated this week
- Representation and Reference Lowering of ONNX Models in MLIR Compiler Infrastructure☆1,071Updated this week
- CUDA Templates and Python DSLs for High-Performance Linear Algebra☆10,748Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- From PyTorch model to end-to-end TensorRT inference experience in two commands—AI-native, cross-platform, and built for the best possible…☆297Updated this week
- ☆36Jul 19, 2025Updated last year
- CUDA Tile IR is an MLIR-based intermediate representation and compiler infrastructure for CUDA kernel optimization, focusing on tile-base…☆1,061Nov 7, 2026Updated last week
- Convert StableHLO models into Apple Core ML format☆22Sep 12, 2026Updated 2 months ago
- The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.☆1,949Updated this week
- MLIR-in as a compiler stack for ucb-bar☆26Updated this week
- Efficient inference / rollout for Cosmos 3 Nano / Edge robot policies☆11Oct 10, 2026Updated last month
- Automatic differentiation for Triton Kernels☆29Aug 12, 2025Updated last year
- GPTQ inference TVM kernel☆41Apr 25, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Unit benchmarks of CUDA event APIs.☆17Apr 23, 2024Updated 2 years ago
- CUDA Kernel Benchmarking Library☆952Updated this week
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆13Nov 23, 2024Updated last year
- ☆119Jul 28, 2026Updated 3 months ago
- NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…☆13,471Updated this week
- [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training☆269Aug 9, 2025Updated last year
- HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…☆210Updated this week
Are these results useful?