TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
☆17Feb 12, 2024Updated 2 years ago
Alternatives and similar repositories for TensorRT-LLM
Users that are interested in TensorRT-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inference with YOLOv5, OpenCV 4.5.4 DNN, C++, ROS and Python☆13Feb 12, 2023Updated 3 years ago
- This repository contains the cpp code to run YoloV8 with bytetrack tracker usinng tensorrt library☆12Mar 28, 2023Updated 3 years ago
- ☆20Jun 30, 2021Updated 5 years ago
- Make backup copies of your music or data CDs. Copy (Clone) most CDs in just a few mouse clicks. Create perfect 1:1 copies or save your CD…☆13Sep 27, 2023Updated 2 years ago
- List UEFI Configuration Tables☆14May 23, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- eBPF Tools - Tool for monitoring, performance benchmarking and tracing linux kernel☆17Jan 29, 2021Updated 5 years ago
- Gin + Gorm Boilerplate☆23Apr 3, 2022Updated 4 years ago
- A small utility to run raw code chunks in the executable memory area.☆16Feb 6, 2015Updated 11 years ago
- ASWF Sample Project☆21Jul 23, 2026Updated 3 weeks ago
- C99 wrapper for the TheMovieDB (TMDb) API☆14Aug 12, 2024Updated 2 years ago
- Vecna is a Python chatbot which recommends songs and movies depending upon your feelings☆12Jun 28, 2022Updated 4 years ago
- Malware Development☆10Sep 30, 2020Updated 5 years ago
- ☆11Apr 30, 2023Updated 3 years ago
- API to harmonised data access for DIAS/WEkEO☆11Dec 15, 2025Updated 7 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A command-line tool for parsing Windows Master File Table ($MFT) and importing the results into Elasticsearch.☆12Jun 3, 2026Updated 2 months ago
- A command-line tool for efficiently extracting files, directories, and alternate data streams directly from NTFS image files.☆21Jun 1, 2026Updated 2 months ago
- Collection of structures, prototype and examples for Microsoft Macro Assembler (MASM) x64.☆16Aug 18, 2020Updated 5 years ago
- WinXPSP2.Cermalus on stereoids, supporting all 32 bits Windows version. Windows Kernel Virus stuff for noobs☆18Aug 11, 2023Updated 3 years ago
- Files required to create a plugin for EmEditor.☆13Jun 30, 2026Updated last month
- Belief Revision based Caption Re-ranker with Visual Semantic Information. COLING 2022☆11Apr 13, 2025Updated last year
- PowerToys Run plugin for searching CanIUse.com☆10Oct 16, 2024Updated last year
- Pure pursuit in pure ROS (Melodic)☆30May 28, 2022Updated 4 years ago
- An extension of the UUV-Simulator for use with Vortex NTNUs autonomous vessels☆36May 17, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A simple GPT-3 interface to automate core legal writing tasks☆13Mar 8, 2023Updated 3 years ago
- Program used by developers to create a graphical interface .ui file☆19Jan 27, 2026Updated 6 months ago
- Super Nintendo Mode 7☆12May 17, 2024Updated 2 years ago
- Dynamics of elastic hard balls in arbitrary number of dimensions in Julia☆16Aug 12, 2023Updated 3 years ago
- Sugarcoat 🍬 is a meta-framework that provides a whole lot of syntactic sugar for creating event-driven multinode systems in ROS2, using …☆38Updated this week
- simple Application Programming Interface framework for inter-application communication with SuperCollider☆18Jan 30, 2015Updated 11 years ago
- this is the git hub repo for SCOPE Studio vscode☆11Apr 25, 2023Updated 3 years ago
- Vector search with Pinecone and Openai to search through contract law textbook. If downloaded, remeber to install all dependencies. Refer…☆11Mar 30, 2023Updated 3 years ago
- ☆17Aug 27, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Notepad++ plugin for Scintillua's LPeg lexers.☆15May 22, 2017Updated 9 years ago
- A Lightweight, header-only CLI option parser for C++☆19Jan 20, 2020Updated 6 years ago
- This exploit is utilising AddressOfEntryPoint of process which is RX and using WriteProcessMemory internal magic to change the permission…☆20Oct 31, 2024Updated last year
- Colab notebook to finetune GLIDE.☆12Mar 22, 2022Updated 4 years ago
- video segment identification system☆14Oct 31, 2021Updated 4 years ago
- 这是一个基于Vue + Vuex + Webpack + Websocket + Iris(go web framework) 开发的简单的多人聊天室☆10Apr 20, 2018Updated 8 years ago
- A Datasette plugin providing an MLOps platform to train, eval and predict machine learning models☆18Aug 3, 2026Updated last week