TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
☆17Feb 12, 2024Updated 2 years ago
Alternatives and similar repositories for TensorRT-LLM
Users that are interested in TensorRT-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12May 12, 2026Updated 5 months ago
- Probabilistic robotic algorithms☆12Feb 5, 2022Updated 4 years ago
- Inference with YOLOv5, OpenCV 4.5.4 DNN, C++, ROS and Python☆13Feb 12, 2023Updated 3 years ago
- This repository contains the cpp code to run YoloV8 with bytetrack tracker usinng tensorrt library☆12Mar 28, 2023Updated 3 years ago
- ☆43Oct 12, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A demo to show how to share a C++ library between ROS 1 and ROS 2☆20Jan 30, 2020Updated 6 years ago
- yolov3 ros node using tensorrt acceleration☆14Jan 27, 2023Updated 3 years ago
- A tool evaluates security configurations of a given PE based on SDL without source code☆15Jul 6, 2014Updated 12 years ago
- Sudo tool for Windows (Super User Do)☆14Mar 23, 2023Updated 3 years ago
- List UEFI Configuration Tables☆16May 23, 2024Updated 2 years ago
- Malware Development☆10Sep 30, 2020Updated 6 years ago
- Make backup copies of your music or data CDs. Copy (Clone) most CDs in just a few mouse clicks. Create perfect 1:1 copies or save your CD…☆13Sep 27, 2023Updated 3 years ago
- MaterialX USD Utilities☆13Aug 9, 2025Updated last year
- eBPF Tools - Tool for monitoring, performance benchmarking and tracing linux kernel☆17Jan 29, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Gin + Gorm Boilerplate☆23Apr 3, 2022Updated 4 years ago
- A simple "hello world" win32 console template☆16Sep 16, 2026Updated last month
- Collection of structures, prototype and examples for Microsoft Macro Assembler (MASM) x64.☆16Aug 18, 2020Updated 6 years ago
- MouseButtonClicker clicks the mouse so you don't have to!☆14Jul 10, 2020Updated 6 years ago
- A description for the plugin☆17Aug 3, 2026Updated 2 months ago
- PowerToys Run plugin for searching CanIUse.com☆10Oct 16, 2024Updated 2 years ago
- this is the git hub repo for SCOPE Studio vscode☆11Apr 25, 2023Updated 3 years ago
- ☆12Apr 30, 2023Updated 3 years ago
- Shellcoder.py - simple script to automate shellcoding process and shellcode testing.☆13Jul 23, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- User-mode program parsing logs created by HyperPlatform☆18Aug 15, 2016Updated 10 years ago
- ☆15Feb 8, 2025Updated last year
- A tool to parse Windows Master File Table ($MFT) and import them into Elasticsearch.☆12Updated this week
- ☆12Dec 15, 2023Updated 2 years ago
- Virtual news production using Tacotron2 and Wav2Lip☆11Nov 14, 2023Updated 2 years ago
- ASWF Sample Project☆21Jul 23, 2026Updated 3 months ago
- Originally from https://www.microsoft.com/en-us/research/project/tuva-richard-feynman ; Project Tuva was discontinued. Here are the lectu…☆11Apr 18, 2020Updated 6 years ago
- WinXPSP2.Cermalus on stereoids, supporting all 32 bits Windows version. Windows Kernel Virus stuff for noobs☆18Aug 11, 2023Updated 3 years ago
- Astronomical Data Query Language Standard☆11Oct 5, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ⚠️ Collection of malicious file ⚠️☆14May 5, 2021Updated 5 years ago
- ☆17Dec 11, 2023Updated 2 years ago
- API to harmonised data access for DIAS/WEkEO☆11Sep 7, 2026Updated last month
- Simple PowerToys Run experimental plugin for quickly open GitKraken repositories☆21Apr 10, 2025Updated last year
- Cloud computing (CC) has recently been receiving tremendous attention from the IT trade and educational researchers. CC leverages its dis…☆10Mar 17, 2021Updated 5 years ago
- Jina Executor used for extracting images and text as chunks from PDF data☆21Mar 28, 2023Updated 3 years ago
- A server-side (TCP server) face morphing engine implemented by Delaunay Triangulation in C++ with OpenFace, OpenCV, and Boost.☆10May 15, 2020Updated 6 years ago