From PyTorch model to end-to-end TensorRT inference experience in two commands—AI-native, cross-platform, and built for the best possible user experience.
☆290Nov 6, 2026Updated this week
Alternatives and similar repositories for TensorRT-Model-Connect
Users that are interested in TensorRT-Model-Connect are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI☆618Updated this week
- A collection of comprehensive guides and shell scripts to streamline the setup and configuration of NVIDIA Jetson boards across various e…☆22Jan 23, 2026Updated 9 months ago
- Forge-CuTe-Py: A PyTorch-native CuTe DSL kernel laboratory for correctness, benchmarking, and profiling.☆13Feb 8, 2026Updated 8 months ago
- ☆13Aug 5, 2026Updated 3 months ago
- ☆25Mar 21, 2026Updated 7 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- NVIDIA AITune is an inference toolkit designed for tuning and deploying Deep Learning models with a focus on NVIDIA GPUs.☆289Updated this week
- ☆11Jul 4, 2026Updated 4 months ago
- Experimental projects related to TensorRT☆128Jul 2, 2026Updated 4 months ago
- Voice and Vision enabled AI studio with Riva/OpenAI backends☆34Updated this week
- [ACM MM 2026] Official code of "FlowAnchor: Stabilizing the Editing Signal for Inversion-Free Video Editing"☆24Updated this week
- Scripts and fixes for running NVIDIA NemoClaw on Jetson AGX Thor☆16Sep 16, 2026Updated last month
- CenterNet3D 部署版本，便于移植不同平台（onnx、tensorRT、rknn、Horizon）。☆14May 24, 2024Updated 2 years ago
- ☆10Aug 27, 2025Updated last year
- NVIDIA NeMo Fabric☆71Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆14Sep 16, 2026Updated last month
- Apple Silicon (Metal) backend for Triton: write standard @triton.jit kernels on your Mac GPU. The same source runs bit-identical on NVIDI…☆26Sep 17, 2026Updated last month
- Qwen3.8-27B NVFP4 (W4A16 shipped recipe) + MTP on NVIDIA DGX Spark GB10/SM121 — vLLM v0.27.2rc0, FP8 KV, 262K context, full reproducibili…☆27Aug 20, 2026Updated 2 months ago
- FlexTensor is a tensor offloading and management library for PyTorch that enables running large models on limited GPU memory by intellige…☆122Oct 28, 2026Updated last week
- learn TensorRT from scratch🥰☆18Sep 29, 2024Updated 2 years ago
- 一步步实现c++中的智能指针☆10Jun 6, 2021Updated 5 years ago
- High Performance Serving Runtime For Interactive Super Intelligence System☆1,706Updated this week
- TokenSpeed is a speed-of-light LLM inference engine.☆2,877Updated this week
- End-to-end formally verified solvers for the general relativistic Maxwell and perfectly hyperbolic general relativistic Maxwell equations…☆28Jul 27, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A web enabled system monitor for NVIDIA Jetson Development Kits☆22Nov 20, 2024Updated last year
- [SIGGRAPH Asia 2026] RealMe: Immersive Volumetric Video from Minimal Captures☆43Oct 22, 2026Updated 2 weeks ago
- A framework for efficient model inference with omni-modality models☆7,579Updated this week
- A scalable, agentic-first, and HuggingFace-native RL framework for research (9k lines).☆1,218Updated this week
- HCC Sample Applications☆13Jan 3, 2017Updated 9 years ago
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 3 months ago
- ☆19Jul 24, 2025Updated last year
- Agentic Skills for Jetson BSP Customization☆73Jun 22, 2026Updated 4 months ago
- Multi-language agent runtime and library for execution scope management, lifecycle events, and middleware on tool and LLM calls.☆234Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A unified VLA post-training framework for human-in-the-loop data collection, fine-tuning, and reinforcement learning.☆151Sep 11, 2026Updated last month
- ☆58Updated this week
- AI/LLM on Kubernetes 基础设施知识库：涵盖 GPU、大数据、调度、分布式训练、LLM 推理、RAG、Agent 与生产运维。| AI/LLM on Kubernetes Infrastructure Knowledge Base: Covering GP…☆32Updated this week
- Helpful kernel tutorials, examples and SKILLs for tile-based GPU programming☆834Updated this week
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆5,546Updated this week
- TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…☆15,027Updated this week
- [SIGGRAPH2026] StyleID : Stylization-Agnostic Identity Encoder☆34Aug 16, 2026Updated 2 months ago