TRT2022/trtllm-llama external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

TRT2022/trtllm-llama

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/TRT2022/trtllm-llama)

Close

TRT2022 / trtllm-llamaView on GitHubMore

• External links
• Readme badge

☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化

☆54Oct 20, 2023Updated 2 years ago

Alternatives and similar repositories for trtllm-llama

Users that are interested in trtllm-llama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• FeiGeChuanShu / trt2023

  View on GitHub
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆43Oct 20, 2023Updated 2 years ago
• YdrMaster / cuda-driver

  View on GitHub
  基于 CUDA Driver API 的 cuda 运行时环境
  ☆16Jul 30, 2025Updated last year
• fuxuelinwudi / ccks2021_track3_baseline

  View on GitHub
  a baseline to practice
  ☆45Jul 6, 2021Updated 5 years ago
• yvonwin / qwen2.cpp

  View on GitHub
  qwen2 and llama3 cpp implementation
  ☆50Jun 7, 2024Updated 2 years ago
• cqu20160901 / DETR_onnx_tensorRT_V2

  View on GitHub
  DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。
  ☆12Jan 9, 2024Updated 2 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• EdVince / whisper-trtllm

  View on GitHub
  Whisper in TensorRT-LLM
  ☆16Sep 21, 2023Updated 2 years ago
• zjhellofss / KuiperLLama

  View on GitHub
  校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。
  ☆575Oct 28, 2025Updated 10 months ago
• coderonion / cuda-beginner-course-cpp-version

  View on GitHub
  bilibili视频【CUDA 12.x 并行编程入门(C++版)】配套代码
  ☆35Aug 12, 2024Updated 2 years ago
• TRT2022 / ControlNet_TensorRT

  View on GitHub
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆50Aug 16, 2023Updated 3 years ago
• yuxiaoranyu / stable_diffusion_trt_triton

  View on GitHub
  ☆20Dec 29, 2023Updated 2 years ago
• DataXujing / YOLOv12-TensorRT

  View on GitHub
  YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现
  ☆14Mar 5, 2025Updated last year
• kivenyangming / OpencvSocket

  View on GitHub
  这是一个使用opencv读取视频并使用socket进行传输视频画面的脚本文件，相较于调用ffmpeg传输节约了90%的数据量
  ☆11May 14, 2024Updated 2 years ago
• Bruce-Lee-LY / flash_attention_inference

  View on GitHub
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆46Feb 27, 2025Updated last year
• AI-confused / CGEC-with-Pointer-Generator-Network-Bart

  View on GitHub
  基于Bart语言模型的指针生成网络，用于中文语法纠错任务
  ☆16Sep 8, 2022Updated 4 years ago
• AI Agents on DigitalOcean Gradient AI Platform • Ad
  Build production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
• caiwanxianhust / FasterLLaMA

  View on GitHub
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆64Nov 8, 2024Updated last year
• yanqiangmiffy / Product-Entity-Recognition

  View on GitHub
  商品标题实体识别
  ☆25Apr 1, 2022Updated 4 years ago
• pertusa / mxnet_predict_cc

  View on GitHub
  MXNet prediction example
  ☆13Dec 14, 2015Updated 10 years ago
• EdVince / model_zoo

  View on GitHub
  Recording models
  ☆13Sep 19, 2023Updated 3 years ago
• rayleizhu / vllm-ra

  View on GitHub
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆40Feb 29, 2024Updated 2 years ago
• louis-she / ai4code

  View on GitHub
  ai4code competition source code
  ☆19Aug 12, 2022Updated 4 years ago
• xlite-dev / longcat-video-fast

  View on GitHub
  🔥LongCat-Video 1.7x🎉 speedup: cache acceleration and 4/8-bits weight only.
  ☆16Oct 28, 2025Updated 10 months ago
• stefanpantic / asr

  View on GitHub
  Automatic speech recognition using neural networks
  ☆18Nov 21, 2020Updated 5 years ago
• Bruce-Lee-LY / cutlass_gemm

  View on GitHub
  Multiple GEMM operators are constructed with cutlass to support LLM inference.
  ☆20Aug 3, 2025Updated last year
• Bare Metal GPUs on DigitalOcean Gradient AI • Ad
  Purpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
• madsys-dev / deepseekv2-profile

  View on GitHub
  ☆156Mar 4, 2025Updated last year
• cuplv / text-to-sql-wizardcoder

  View on GitHub
  Leveraging large language models for text-to-SQL synthesis, this project fine-tunes WizardLM/WizardCoder-15B-V1.0 with QLoRA on a custom …
  ☆45Dec 12, 2023Updated 2 years ago
• maomao124 / java_crawling_medical_question_bank_network

  View on GitHub
  java爬取医学题库网
  ☆10Feb 1, 2023Updated 3 years ago
• fuxuelinwudi / BERT_CRF_NER_torch

  View on GitHub
  ☆11Mar 6, 2022Updated 4 years ago
• fuxuelinwudi / 2022-gaiic-track1-itmatch-baseline2022.3.2

  View on GitHub
  ☆22Mar 3, 2022Updated 4 years ago
• mtenenholtz / lmsys-chatbot-arena-solution

  View on GitHub
  ☆15Aug 26, 2024Updated 2 years ago
• Qengineering / NanoDet-ncnn-Jetson-Nano

  View on GitHub
  NanoDet for Jetson Nano
  ☆11Sep 30, 2023Updated 2 years ago
• mostafa-shalaby84 / hair_segmentation_matting

  View on GitHub
  ☆13Jan 23, 2020Updated 6 years ago
• hopef / llama3_chat

  View on GitHub
  Llama3 Streaming Chat Sample
  ☆22Apr 24, 2024Updated 2 years ago
• Simple, predictable pricing with DigitalOcean hosting • Ad
  Always know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
• NonvolatileMemory / flash_tree_attn

  View on GitHub
  ☆20Dec 24, 2024Updated last year
• ZHEQIUSHUI / SAM-ONNX-AX650-CPP

  View on GitHub
  SAM and lama inpaint，包含QT的GUI交互界面，实现了交互式可实时显示结果的画点、画框进行SAM，然后通过进行Inpaint，具体操作看readme里的视频。
  ☆54Jan 30, 2024Updated 2 years ago
• hova88 / CUDA-MatMul-Practice

  View on GitHub
  ☆19Jan 4, 2024Updated 2 years ago
• Rayrtfr / FasterTransformer

  View on GitHub
  Transformer related optimization, including BERT, GPT
  ☆17Jul 29, 2023Updated 3 years ago
• vllm-project / tml-fa4

  View on GitHub
  FA4-based Relative Attention Kernel developed by TML and Colfax
  ☆18Sep 11, 2026Updated last week
• TRT2022 / MST-plus-plus-TensorRT

  View on GitHub
  TensorRT 2022复赛方案： 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化
  ☆143Jul 6, 2022Updated 4 years ago
• iwatake2222 / InferenceHelper_Sample

  View on GitHub
  Sample projects for InferenceHelper, a Helper Class for Deep Learning Inference Frameworks: TensorFlow Lite, TensorRT, OpenCV, ncnn, MNN,…
  ☆22Mar 27, 2022Updated 4 years ago