TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
☆17Feb 12, 2024Updated 2 years ago
Alternatives and similar repositories for TensorRT-LLM
Users that are interested in TensorRT-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GitHub tool for CodeX Bot platform☆16May 4, 2023Updated 3 years ago
- Animal Video Analysis Tool (AVAT)☆14May 12, 2026Updated 2 months ago
- Java版日レセクライアント☆12Jan 4, 2022Updated 4 years ago
- Research Software Design by Example☆13Sep 7, 2025Updated 10 months ago
- Code and notes regarding Malware Development☆11Oct 30, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Bayesian Inverse Graphics for Few-Shot Concept Learning☆12Mar 16, 2025Updated last year
- Convert an audio file to a waveform video☆11Nov 10, 2023Updated 2 years ago
- ☆13Nov 28, 2023Updated 2 years ago
- List UEFI Configuration Tables☆14May 23, 2024Updated 2 years ago
- eBPF Tools - Tool for monitoring, performance benchmarking and tracing linux kernel☆17Jan 29, 2021Updated 5 years ago
- Discord AI bot with a hybrid command system, imagination generation, free LLM model, mention recognition, smart message handling, channel…☆14Oct 13, 2024Updated last year
- ☆10Feb 22, 2018Updated 8 years ago
- Display PDFs in your RAG app☆20Feb 24, 2025Updated last year
- Custom computed columns for Glide☆24Apr 11, 2026Updated 3 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ASWF Sample Project☆19Nov 19, 2024Updated last year
- ☆25Apr 18, 2023Updated 3 years ago
- WizardsToolkit is a secure C library offering cross-platform cryptography, hashing, authentication, and data integrity tools. It supports…☆16Jul 15, 2026Updated last week
- ☆18May 23, 2024Updated 2 years ago
- Simple PowerToys Run experimental plugin for quickly open GitKraken repositories☆22Apr 10, 2025Updated last year
- Simple site for creating demos of farmOS.☆18Mar 21, 2026Updated 4 months ago
- Using Artificial Intelligence to Augment Human Intelligence☆20May 22, 2018Updated 8 years ago
- ☆12Feb 5, 2021Updated 5 years ago
- Gyroscope☆19May 14, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆22Jan 11, 2023Updated 3 years ago
- WinXPSP2.Cermalus on stereoids, supporting all 32 bits Windows version. Windows Kernel Virus stuff for noobs☆18Aug 11, 2023Updated 2 years ago
- This repository contains the code for the paper LDFA: Latent Diffusion Face Anonymization for Self-driving Applications☆16Jun 24, 2026Updated last month
- Belief Revision based Caption Re-ranker with Visual Semantic Information. COLING 2022☆11Apr 13, 2025Updated last year
- PowerToys Run plugin for searching CanIUse.com☆11Oct 16, 2024Updated last year
- An app for generating prompts☆28Updated this week
- .Net Standard SDK library for WeatherAPI.com Weather API☆16Dec 17, 2024Updated last year
- Extended Reality (XR) - Building AR | VR | MR Projects, published by Packt☆19Jan 30, 2023Updated 3 years ago
- A simple GPT-3 interface to automate core legal writing tasks☆13Mar 8, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Jina Executor used for extracting images and text as chunks from PDF data☆21Mar 28, 2023Updated 3 years ago
- Super Nintendo Mode 7☆12May 17, 2024Updated 2 years ago
- An implementation of Compositional Attention: Disentangling Search and Retrieval by MILA☆14Jun 1, 2022Updated 4 years ago
- Repo for the Deep Reinforcement Learning Nanodegree program☆12Jun 12, 2023Updated 3 years ago
- Dynamics of elastic hard balls in arbitrary number of dimensions in Julia☆16Aug 12, 2023Updated 2 years ago
- ☆19May 10, 2024Updated 2 years ago
- Graphical frontend of Android Debug Bridge (adb)☆14Oct 12, 2016Updated 9 years ago