TRT2022/trtllm-llama external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

TRT2022/trtllm-llama

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/TRT2022/trtllm-llama)

Close

TRT2022 / trtllm-llamaView on GitHubMore

• External links
• Readme badge

☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化

☆54Oct 20, 2023Updated 2 years ago

Alternatives and similar repositories for trtllm-llama

Users that are interested in trtllm-llama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• FeiGeChuanShu / trt2023

  View on GitHub
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆43Oct 20, 2023Updated 2 years ago
• YdrMaster / cuda-driver

  View on GitHub
  基于 CUDA Driver API 的 cuda 运行时环境
  ☆16Jul 30, 2025Updated last year
• fuxuelinwudi / ccks2021_track3_baseline

  View on GitHub
  a baseline to practice
  ☆45Jul 6, 2021Updated 5 years ago
• yvonwin / qwen2.cpp

  View on GitHub
  qwen2 and llama3 cpp implementation
  ☆50Jun 7, 2024Updated 2 years ago
• cqu20160901 / DETR_onnx_tensorRT_V2

  View on GitHub
  DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。
  ☆12Jan 9, 2024Updated 2 years ago
• Bare Metal GPUs on DigitalOcean Gradient AI • Ad
  Purpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
• EdVince / whisper-trtllm

  View on GitHub
  Whisper in TensorRT-LLM
  ☆16Sep 21, 2023Updated 2 years ago
• zjhellofss / KuiperLLama

  View on GitHub
  校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。
  ☆572Oct 28, 2025Updated 10 months ago
• coderonion / cuda-beginner-course-cpp-version

  View on GitHub
  bilibili视频【CUDA 12.x 并行编程入门(C++版)】配套代码
  ☆35Aug 12, 2024Updated 2 years ago
• TRT2022 / ControlNet_TensorRT

  View on GitHub
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆50Aug 16, 2023Updated 3 years ago
• yuxiaoranyu / stable_diffusion_trt_triton

  View on GitHub
  ☆20Dec 29, 2023Updated 2 years ago
• bojone / sohu2021-baseline

  View on GitHub
  2021搜狐校园文本匹配算法大赛baseline
  ☆45Apr 16, 2021Updated 5 years ago
• DataXujing / YOLOv12-TensorRT

  View on GitHub
  YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现
  ☆14Mar 5, 2025Updated last year
• kivenyangming / OpencvSocket

  View on GitHub
  这是一个使用opencv读取视频并使用socket进行传输视频画面的脚本文件，相较于调用ffmpeg传输节约了90%的数据量
  ☆11May 14, 2024Updated 2 years ago
• seasonjs / rwkv

  View on GitHub
  pure go for rwkv
  ☆18Dec 31, 2023Updated 2 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• Bruce-Lee-LY / flash_attention_inference

  View on GitHub
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆45Feb 27, 2025Updated last year
• AI-confused / CGEC-with-Pointer-Generator-Network-Bart

  View on GitHub
  基于Bart语言模型的指针生成网络，用于中文语法纠错任务
  ☆16Sep 8, 2022Updated 3 years ago
• pertusa / mxnet_predict_cc

  View on GitHub
  MXNet prediction example
  ☆13Dec 14, 2015Updated 10 years ago
• EdVince / model_zoo

  View on GitHub
  Recording models
  ☆13Sep 19, 2023Updated 2 years ago
• rayleizhu / vllm-ra

  View on GitHub
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆39Feb 29, 2024Updated 2 years ago
• xlite-dev / qwen-image-fast

  View on GitHub
  ⚡️Qwen-Image 4.8x🎉 speedup with Hybrid Acceleration for low VRAM GPUs
  ☆17Oct 24, 2025Updated 10 months ago
• cvdong / YOLO_TRT_SIM

  View on GitHub
  高效部署：YOLO X, V3, V4, V5, V6, V7, V8, EdgeYOLO TRT推理 ™️ ,前后处理均由CUDA核函数实现 CPP/CUDA🚀
  ☆54Feb 23, 2023Updated 3 years ago
• xlite-dev / longcat-video-fast

  View on GitHub
  🔥LongCat-Video 1.7x🎉 speedup: cache acceleration and 4/8-bits weight only.
  ☆15Oct 28, 2025Updated 10 months ago
• Bruce-Lee-LY / cutlass_gemm

  View on GitHub
  Multiple GEMM operators are constructed with cutlass to support LLM inference.
  ☆20Aug 3, 2025Updated last year
• Serverless GPU API endpoints on Runpod - Get Bonus Credits • Ad
  Skip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
• stefanpantic / asr

  View on GitHub
  Automatic speech recognition using neural networks
  ☆18Nov 21, 2020Updated 5 years ago
• JiangLiSJTU / token-ring

  View on GitHub
  ☆13Jan 7, 2025Updated last year
• cuplv / text-to-sql-wizardcoder

  View on GitHub
  Leveraging large language models for text-to-SQL synthesis, this project fine-tunes WizardLM/WizardCoder-15B-V1.0 with QLoRA on a custom …
  ☆45Dec 12, 2023Updated 2 years ago
• fuxuelinwudi / BERT_CRF_NER_torch

  View on GitHub
  ☆11Mar 6, 2022Updated 4 years ago
• fuxuelinwudi / 2022-gaiic-track1-itmatch-baseline2022.3.2

  View on GitHub
  ☆22Mar 3, 2022Updated 4 years ago
• fuxuelinwudi / daguancup_end2end

  View on GitHub
  ☆10Jan 7, 2022Updated 4 years ago
• Qengineering / NanoDet-ncnn-Jetson-Nano

  View on GitHub
  NanoDet for Jetson Nano
  ☆11Sep 30, 2023Updated 2 years ago
• wbchief / 2022_GAIIC_Task2_5st

  View on GitHub
  ☆26Dec 2, 2022Updated 3 years ago
• BaguaSys / tutorials

  View on GitHub
  Bagua tutorials.
  ☆13Sep 4, 2022Updated 3 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• autowarefoundation / spconv_cpp

  View on GitHub
  ☆21May 26, 2026Updated 3 months ago
• LCH1238 / BEVDet

  View on GitHub
  A fork of the BEVDet series .
  ☆22Oct 8, 2023Updated 2 years ago
• NonvolatileMemory / flash_tree_attn

  View on GitHub
  ☆20Dec 24, 2024Updated last year
• ZHEQIUSHUI / SAM-ONNX-AX650-CPP

  View on GitHub
  SAM and lama inpaint，包含QT的GUI交互界面，实现了交互式可实时显示结果的画点、画框进行SAM，然后通过进行Inpaint，具体操作看readme里的视频。
  ☆54Jan 30, 2024Updated 2 years ago
• hova88 / CUDA-MatMul-Practice

  View on GitHub
  ☆19Jan 4, 2024Updated 2 years ago
• Rayrtfr / FasterTransformer

  View on GitHub
  Transformer related optimization, including BERT, GPT
  ☆17Jul 29, 2023Updated 3 years ago
• vllm-project / tml-fa4

  View on GitHub
  FA4-based Relative Attention Kernel developed by TML and Colfax
  ☆18Jul 17, 2026Updated last month