TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
☆17Feb 12, 2024Updated 2 years ago
Alternatives and similar repositories for TensorRT-LLM
Users that are interested in TensorRT-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository contains the cpp code to run YoloV8 with bytetrack tracker usinng tensorrt library☆12Mar 28, 2023Updated 3 years ago
- High-speed Deep learning API Server with Libtorch (C++) and Gin (Golang)☆17Jun 8, 2019Updated 7 years ago
- A demo to show how to share a C++ library between ROS 1 and ROS 2☆20Jan 30, 2020Updated 6 years ago
- ☆10Feb 22, 2018Updated 8 years ago
- Vecna is a Python chatbot which recommends songs and movies depending upon your feelings☆12Jun 28, 2022Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Machine learning☆10Jan 12, 2018Updated 8 years ago
- Belief Revision based Caption Re-ranker with Visual Semantic Information. COLING 2022☆11Apr 13, 2025Updated last year
- ROS Packages for Husky Robot☆35Sep 25, 2023Updated 2 years ago
- Pure pursuit in pure ROS (Melodic)☆30May 28, 2022Updated 4 years ago
- An extension of the UUV-Simulator for use with Vortex NTNUs autonomous vessels☆36May 17, 2023Updated 3 years ago
- A simple GPT-3 interface to automate core legal writing tasks☆13Mar 8, 2023Updated 3 years ago
- Super Nintendo Mode 7☆12May 17, 2024Updated 2 years ago
- An implementation of Compositional Attention: Disentangling Search and Retrieval by MILA☆14Jun 1, 2022Updated 4 years ago
- Graphical frontend of Android Debug Bridge (adb)☆14Oct 12, 2016Updated 9 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Vector search with Pinecone and Openai to search through contract law textbook. If downloaded, remeber to install all dependencies. Refer…☆11Mar 30, 2023Updated 3 years ago
- Object Detection 2Dto3D by Yolov5 ,TensorRT ,Matched by clustering☆33Dec 27, 2020Updated 5 years ago
- video segment identification system☆14Oct 31, 2021Updated 4 years ago
- A Datasette plugin providing an MLOps platform to train, eval and predict machine learning models☆18Aug 3, 2026Updated 3 weeks ago
- We archive data because we are interested in the diffs. All data is from https://video-api.cartoonnetwork.com. We run the check every min…☆11Updated this week
- Golang library for parsing FBX files☆12Jul 22, 2023Updated 3 years ago
- A pathway and collection of resources to learning Jax from beginning to advance.☆11Jan 2, 2021Updated 5 years ago
- Decentralized distributed system built using blockchain technology to provide a marketplace for users to trade their processing power in …☆11May 27, 2018Updated 8 years ago
- phonetic similarity algorithms☆13Jun 19, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Sep 7, 2020Updated 5 years ago
- Non-local Modeling for Image Quality Assessment☆13Dec 20, 2023Updated 2 years ago
- This is a dehazed method for remote sensing image, which based on CycleGAN.☆12May 10, 2022Updated 4 years ago
- Get github contribution with a face detection app. Dragon ball fantasy!☆14Jul 18, 2023Updated 3 years ago
- ☆14Aug 30, 2022Updated 4 years ago
- Official repository of Tapir Lab.'s Lip-Sync Method☆10Oct 3, 2023Updated 2 years ago
- POC of a simple 2D roguelike game with multiplayer.☆15Jul 7, 2018Updated 8 years ago
- UnityIAPを個人的に使いやすくまとめたものです。☆13Feb 2, 2018Updated 8 years ago
- Scraping LegiFrance naturalisation decrees for fun and OSINT profit☆12May 27, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Automated Question-Answering Over Knowledge Graphs in O&M of Wind Turbines☆14Aug 16, 2022Updated 4 years ago
- Create a realtime poll using Go and Pusher☆14Jun 17, 2018Updated 8 years ago
- Extract information from XBRL files in the ESEF format☆13Jan 3, 2026Updated 8 months ago
- A reddit scraping and analysis bot to visualize linguistic and content trends☆12Oct 5, 2021Updated 4 years ago
- The main objective of this experiment is detect blur on face pictures to improve the results of face recognition process.☆14Jan 14, 2023Updated 3 years ago
- Code and pruned models for our paper: K. Gkrispanis, N. Gkalelis, V. Mezaris, "Filter-Pruning of Lightweight Face Detectors Using a Geome…☆14May 8, 2024Updated 2 years ago
- Research project based on vector drawing with a text-to-image generative AI model called CLIP. View a demo video here: https://vimeo.com/…☆11Jan 17, 2024Updated 2 years ago