TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
☆17Feb 12, 2024Updated 2 years ago
Alternatives and similar repositories for TensorRT-LLM
Users that are interested in TensorRT-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- a React library to sync audio and text, highlighting the text as the audio "reads" it☆13Jul 7, 2023Updated 3 years ago
- ☆49Sep 29, 2026Updated 2 weeks ago
- Research Software Design by Example☆13Sep 7, 2025Updated last year
- Code and notes regarding Malware Development☆11Oct 30, 2022Updated 3 years ago
- Bayesian Inverse Graphics for Few-Shot Concept Learning☆12Mar 16, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Make backup copies of your music or data CDs. Copy (Clone) most CDs in just a few mouse clicks. Create perfect 1:1 copies or save your CD…☆13Sep 27, 2023Updated 3 years ago
- Voila! A smart automatic pet feeder using Arduino Uno + RTC time module for scheduling + multiple sensors.☆10Jun 4, 2024Updated 2 years ago
- eBPF Tools - Tool for monitoring, performance benchmarking and tracing linux kernel☆17Jan 29, 2021Updated 5 years ago
- Fancylit is a python module that contains pre-packaged Streamlit code to render fancy visualizations, run modeling tasks, and data explor…☆11Oct 19, 2021Updated 4 years ago
- KakaoTalk robot which automatically answer to your command☆11Feb 24, 2014Updated 12 years ago
- Discord AI bot with a hybrid command system, imagination generation, free LLM model, mention recognition, smart message handling, channel…☆14Oct 13, 2024Updated 2 years ago
- https://github.com/Significant-Gravitas/Catalysts☆16May 13, 2023Updated 3 years ago
- List UEFI Configuration Tables☆16May 23, 2024Updated 2 years ago
- Custom computed columns for Glide☆24Apr 11, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A small utility to run raw code chunks in the executable memory area.☆16Feb 6, 2015Updated 11 years ago
- ☆25Apr 18, 2023Updated 3 years ago
- C99 wrapper for the TheMovieDB (TMDb) API☆14Aug 12, 2024Updated 2 years ago
- ☆12Dec 15, 2023Updated 2 years ago
- Vecna is a Python chatbot which recommends songs and movies depending upon your feelings☆12Jun 28, 2022Updated 4 years ago
- API to harmonised data access for DIAS/WEkEO☆11Sep 7, 2026Updated last month
- Sample radare2 project templates☆16Jan 23, 2026Updated 8 months ago
- Simple site for creating demos of farmOS.☆19Mar 21, 2026Updated 6 months ago
- ☆15Mar 10, 2026Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Gyroscope☆18May 14, 2026Updated 4 months ago
- ☆12Feb 5, 2021Updated 5 years ago
- A Visual Studio extension☆13Mar 3, 2024Updated 2 years ago
- ☆14Jun 18, 2024Updated 2 years ago
- This repository contains the code for the paper LDFA: Latent Diffusion Face Anonymization for Self-driving Applications☆16Jun 24, 2026Updated 3 months ago
- A simple GPT-3 interface to automate core legal writing tasks☆13Mar 8, 2023Updated 3 years ago
- An implementation of Compositional Attention: Disentangling Search and Retrieval by MILA☆14Jun 1, 2022Updated 4 years ago
- An efficient multi-locus mixed-model approach for genome-wide association studies in structured populations☆15Mar 6, 2018Updated 8 years ago
- Repo for the Deep Reinforcement Learning Nanodegree program☆12Jun 12, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Vector search with Pinecone and Openai to search through contract law textbook. If downloaded, remeber to install all dependencies. Refer…☆11Mar 30, 2023Updated 3 years ago
- Official Implementation of UA^{2}-Agent and other baseline algorithms of "Towards Unified Alignment Between Agents, Humans, and Environme…☆20Nov 12, 2024Updated last year
- Multimodal Neurons in Artificial Neural Networks☆16Oct 18, 2021Updated 4 years ago
- A Datasette plugin providing an MLOps platform to train, eval and predict machine learning models☆18Oct 5, 2026Updated last week
- We archive data because we are interested in the diffs. All data is from https://video-api.cartoonnetwork.com. We run the check every min…☆11Updated this week
- Chat with your documents locally☆15Mar 26, 2024Updated 2 years ago
- Feature-Wise Transformations☆22Jul 10, 2018Updated 8 years ago