TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
☆17Feb 12, 2024Updated 2 years ago
Alternatives and similar repositories for TensorRT-LLM
Users that are interested in TensorRT-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inference with YOLOv5, OpenCV 4.5.4 DNN, C++, ROS and Python☆13Feb 12, 2023Updated 3 years ago
- This repository contains the cpp code to run YoloV8 with bytetrack tracker usinng tensorrt library☆12Mar 28, 2023Updated 3 years ago
- a React library to sync audio and text, highlighting the text as the audio "reads" it☆13Jul 7, 2023Updated 3 years ago
- yolov3 ros node using tensorrt acceleration☆14Jan 27, 2023Updated 3 years ago
- A demo to show how to share a C++ library between ROS 1 and ROS 2☆20Jan 30, 2020Updated 6 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Animal Video Analysis Tool (AVAT)☆14May 12, 2026Updated 4 months ago
- ☆20Jun 30, 2021Updated 5 years ago
- ☆50Updated this week
- Sudo tool for Windows (Super User Do)☆14Mar 23, 2023Updated 3 years ago
- A simple "hello world" win32 console template☆16Sep 16, 2026Updated last week
- Bayesian Inverse Graphics for Few-Shot Concept Learning☆12Mar 16, 2025Updated last year
- Make backup copies of your music or data CDs. Copy (Clone) most CDs in just a few mouse clicks. Create perfect 1:1 copies or save your CD…☆13Sep 27, 2023Updated 2 years ago
- Convert an audio file to a waveform video☆11Nov 10, 2023Updated 2 years ago
- ☆13Nov 28, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- eBPF Tools - Tool for monitoring, performance benchmarking and tracing linux kernel☆17Jan 29, 2021Updated 5 years ago
- Gin + Gorm Boilerplate☆23Apr 3, 2022Updated 4 years ago
- Fancylit is a python module that contains pre-packaged Streamlit code to render fancy visualizations, run modeling tasks, and data explor…☆11Oct 19, 2021Updated 4 years ago
- KakaoTalk robot which automatically answer to your command☆11Feb 24, 2014Updated 12 years ago
- Discord AI bot with a hybrid command system, imagination generation, free LLM model, mention recognition, smart message handling, channel…☆14Oct 13, 2024Updated last year
- ☆10Feb 22, 2018Updated 8 years ago
- https://github.com/Significant-Gravitas/Catalysts☆16May 13, 2023Updated 3 years ago
- List UEFI Configuration Tables☆16May 23, 2024Updated 2 years ago
- Apache OpenNLP Models☆17Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Display PDFs in your RAG app☆21Feb 24, 2025Updated last year
- Sigmpilot is an online demo for Sigma embedded engineering clients representing our skills in autonomous robotics, sensor fusion and simu…☆27Jan 9, 2023Updated 3 years ago
- ASWF Sample Project☆21Jul 23, 2026Updated 2 months ago
- SimpleVideoPlayer Channel remastered in SceneGraph☆15Nov 17, 2016Updated 9 years ago
- ☆25Apr 18, 2023Updated 3 years ago
- ☆12Dec 15, 2023Updated 2 years ago
- Malware Development☆10Sep 30, 2020Updated 5 years ago
- WizardsToolkit is a secure C library offering cross-platform cryptography, hashing, authentication, and data integrity tools. It supports…☆16Updated this week
- ☆12Apr 30, 2023Updated 3 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆15Feb 8, 2025Updated last year
- Simple PowerToys Run experimental plugin for quickly open GitKraken repositories☆21Apr 10, 2025Updated last year
- Sample radare2 project templates☆16Jan 23, 2026Updated 7 months ago
- Collection of structures, prototype and examples for Microsoft Macro Assembler (MASM) x64.☆16Aug 18, 2020Updated 6 years ago
- ☆17Dec 11, 2023Updated 2 years ago
- Machine learning☆10Jan 12, 2018Updated 8 years ago
- ☆15Mar 10, 2026Updated 6 months ago