Alternatives and similar repositories for TensorRT-Edge-LLM

Users that are interested in TensorRT-Edge-LLM are comparing it to the libraries listed below

• NVIDIA / Deep-Learning-Accelerator-SW
  NVIDIA DLA-SW, the recipes and tools for running deep learning workloads on NVIDIA DLA cores for inference applications.
  ☆224Updated last year
• leimao / TensorRT-Custom-Plugin-Example
  Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration
  ☆78Updated 8 months ago
• NVIDIA-AI-IOT / tensorrt_plugin_generator
  A simple tool that can generate TensorRT plugin code quickly.
  ☆238Updated 2 years ago
• NVIDIA-AI-IOT / cuDLA-samples
  YOLOv5 on Orin DLA
  ☆221Updated last year
• NVIDIA-AI-IOT / jetson_dla_tutorial
  A tutorial for getting started with the Deep Learning Accelerator (DLA) on NVIDIA Jetson
  ☆363Updated 3 years ago
• lix19937 / tensorrt-insight
  Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda
  ☆22Updated 2 weeks ago
• HeKun-NVIDIA / AI-Blog
  Collection of blogs on AI development
  ☆21Updated last year
• Tencent / TPAT
  TensorRT Plugin Autogen Tool
  ☆367Updated 2 years ago
• ModelTC / Dipoorlet
  Offline Quantization Tools for Deploy.
  ☆141Updated 2 years ago
• kalfazed / multi-thread-programming
  This is a repository to practice multi-thread programming in C++
  ☆27Updated last year
• CalvinXKY / BasicCUDA
  A tutorial for CUDA&PyTorch
  ☆208Updated last week
• DerryHub / BEVFormer_tensorrt
  BEVFormer inference on TensorRT, including INT8 Quantization and Custom TensorRT Plugins (float/half/half2/int8).
  ☆551Updated 2 years ago
• HeKun-NVIDIA / TensorRT-Developer_Guide_in_Chinese
  ☆311Updated 3 years ago
• jinmin527 / learning-cuda-trt
  A large number of cuda/tensorrt cases . 大量案例来学习cuda/tensorrt
  ☆170Updated 3 years ago
• agrechnev / trt-cpp-min
  TensorRT 7 C++ (almost) minimal examples
  ☆84Updated 2 years ago
• NVIDIA / DL4AGX
  Deep Learning tools and applications for NVIDIA AGX platforms.
  ☆265Updated this week
• OpenPPL / ppl.kernel.cuda
  ☆38Updated last year
• shouxieai / tensorRT_quantization
  该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。
  ☆71Updated 2 years ago
• zhangcheng828 / TensorRT-Plugin
  ☆45Updated 3 years ago
• LCH1238 / BEVDet
  A fork of the BEVDet series .
  ☆21Updated 2 years ago
• ThanatosShinji / onnx-tool
  A parser, editor and profiler tool for ONNX models.
  ☆476Updated 2 months ago
• hopef / llama3_chat
  Llama3 Streaming Chat Sample
  ☆22Updated last year
• Tencent / hpc-ops
  High Performance LLM Inference Operator Library
  ☆603Updated this week
• MegEngine / examples
  A set of examples around MegEngine
  ☆31Updated 2 years ago
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆170Updated last week
• FindDefinition / PCCM
  Python C++ Code Manager
  ☆15Updated last year
• YirongMao / TensorRT-Custom-Plugin
  This repository describes how to add a custom TensorRT plugin in c++ and python
  ☆29Updated 4 years ago
• OpenPPL / ppl.pmx
  ☆60Updated last year
• Tlntin / trt2023
  ☆26Updated 2 years ago
• OpenPPL / ppl.llm.kernel.cuda
  ☆152Updated last year