Tlntin/ChatGLM2-6B-TensorRT external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

Tlntin/ChatGLM2-6B-TensorRT

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/Tlntin/ChatGLM2-6B-TensorRT)

Close

Tlntin / ChatGLM2-6B-TensorRTView on GitHubMore

• External links
• Readme badge

☆90Jun 30, 2023Updated 2 years ago

Alternatives and similar repositories for ChatGLM2-6B-TensorRT

Users that are interested in ChatGLM2-6B-TensorRT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• TRT2022 / ControlNet_TensorRT

  View on GitHub
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆50Aug 16, 2023Updated 2 years ago
• Tlntin / trt2023

  View on GitHub
  ☆26Aug 15, 2023Updated 2 years ago
• K024 / chatglm-q

  View on GitHub
  Another ChatGLM2 implementation for GPTQ quantization
  ☆55Oct 15, 2023Updated 2 years ago
• latentCall145 / channels-last-groupnorm

  View on GitHub
  A CUDA kernel for NHWC GroupNorm for PyTorch
  ☆23Nov 15, 2024Updated last year
• guoguo1314 / llama3_learn.c

  View on GitHub
  Inference deployment of the llama3
  ☆10Apr 21, 2024Updated last year
• Virtual machines for every use case on DigitalOcean • Ad
  Get dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
• YukSing12 / anchordetr_tensorrt

  View on GitHub
  trt-hackathon-2022 三等奖方案
  ☆10Mar 6, 2023Updated 3 years ago
• EdVince / whisper-trtllm

  View on GitHub
  Whisper in TensorRT-LLM
  ☆17Sep 21, 2023Updated 2 years ago
• triple-mu / TensorRT2ONNX

  View on GitHub
  A tool convert TensorRT engine/plan to a fake onnx
  ☆41Nov 22, 2022Updated 3 years ago
• keddyjin / TensorRT_StableDiffusion_ControlNet

  View on GitHub
  NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that del…
  ☆26Jul 21, 2023Updated 2 years ago
• Tlntin / Qwen-TensorRT-LLM

  View on GitHub
  ☆620Jul 31, 2024Updated last year
• EdVince / llm-cpp

  View on GitHub
  ☆32Jul 23, 2024Updated last year
• wangzhaode / mnn-llm

  View on GitHub
  llm deploy project based mnn. This project has merged into MNN.
  ☆1,617Jan 20, 2025Updated last year
• ztxz16 / fastllm

  View on GitHub
  fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型，单并发20tps；INT4量化模型单并发30tp…
  ☆4,173Updated this week
• triple-mu / Stable-Diffusion-TensorRT

  View on GitHub
  Stable Diffusion in TensorRT 8.5+
  ☆14Mar 19, 2023Updated 3 years ago
• DigitalOcean Gradient AI Platform • Ad
  Build production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
• chineseocr / ai-medical

  View on GitHub
  陆续开源医疗行业的深度学习模型及数据集
  ☆13Dec 30, 2021Updated 4 years ago
• richjjj / cuvid-tensorrt-multi

  View on GitHub
  ffmpeg+cuvid+tensorrt+multicamera
  ☆12Dec 31, 2024Updated last year
• tlc-pack / cutlass_fpA_intB_gemm

  View on GitHub
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆95Feb 20, 2026Updated last month
• cqu20160901 / FastSAM_onnx_rknn

  View on GitHub
  FastSAM 部署版本，便于移植不同平，部署简单、运行速度快。
  ☆23May 30, 2024Updated last year
• Zhou-wy / TRT-YOLOv8-Seg

  View on GitHub
  使用TensorRT加速YOLOv8-Seg，完整的后端框架，包括Http服务器，Mysql数据库，ffmpeg视频推流等。
  ☆87Oct 9, 2023Updated 2 years ago
• lxl24 / SwinTransformerV2_TensorRT

  View on GitHub
  For 2022 Nvidia Hackathon
  ☆22Jun 28, 2022Updated 3 years ago
• richjjj / duscratch

  View on GitHub
  搜藏的希望的代码片段
  ☆12Jun 6, 2023Updated 2 years ago
• shouxieai / A-series-of-CV

  View on GitHub
  ☆57Aug 21, 2023Updated 2 years ago
• dingyuqing05 / trt2022_wenet

  View on GitHub
  ☆70Dec 9, 2022Updated 3 years ago
• Proton VPN Special Offer - Get 70% off • Ad
  Special partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
• tlc-pack / libflash_attn

  View on GitHub
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆112Sep 10, 2024Updated last year
• l-sf / Nanodet_openvino_quant_deploy

  View on GitHub
  本仓库在OpenVINO推理框架下部署Nanodet检测算法，并重写预处理和后处理部分，具有超高性能！让你在Intel CPU平台上的检测速度起飞！ 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度，推理速度更快！
  ☆16Jun 14, 2023Updated 2 years ago
• shibing624 / lmft

  View on GitHub
  ChatGLM-6B fine-tuning.
  ☆136Apr 25, 2023Updated 2 years ago
• sesmfs / onnx_quant_tool

  View on GitHub
  An onnx-based quantitation tool.
  ☆71Jan 8, 2024Updated 2 years ago
• shouxieai / hard_decode_trt

  View on GitHub
  Yolov5 inference on NVDec hardware decoder
  ☆89Nov 6, 2021Updated 4 years ago
• taishan1994 / Chinese-LLaMA-Alpaca-LoRA-Tuning

  View on GitHub
  使用LoRA对Chinese-LLaMA-Alpaca进行微调。
  ☆35May 26, 2023Updated 2 years ago
• ZHEQIUSHUI / SAM-ONNX-AX650-CPP

  View on GitHub
  SAM and lama inpaint，包含QT的GUI交互界面，实现了交互式可实时显示结果的画点、画框进行SAM，然后通过进行Inpaint，具体操作看readme里的视频。
  ☆52Jan 30, 2024Updated 2 years ago
• wangzhaode / llm-export

  View on GitHub
  llm-export can export llm model to onnx.
  ☆344Oct 24, 2025Updated 5 months ago
• jimmy-evo / opencl_kernels

  View on GitHub
  An easy way to run, test, benchmark and tune OpenCL kernel files
  ☆24Aug 25, 2023Updated 2 years ago
• Managed Database hosting by DigitalOcean • Ad
  PostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
• DataXujing / TensorRT-DETR

  View on GitHub
  NVIDIA-阿里2021 TRT比赛 `二等奖` 代码提交 团队：美迪康 AI Lab
  ☆175Jul 29, 2022Updated 3 years ago
• hnsywangxin / controlnet_stable_tensorrt

  View on GitHub
  stable diffusion, controlnet, tensorrt, accelerate
  ☆110Apr 28, 2023Updated 2 years ago
• wangzhaode / mnn-stable-diffusion

  View on GitHub
  stable diffusion using mnn
  ☆67Sep 28, 2023Updated 2 years ago
• yongzhuo / chatglm-maths

  View on GitHub
  chatglm-6b微调/LORA/PPO/推理, 样本为自动生成的整数/小数加减乘除运算, 可gpu/cpu
  ☆165Aug 24, 2023Updated 2 years ago
• zhaohb / fastapi_tritonserver

  View on GitHub
  ☆28Nov 6, 2024Updated last year
• openvino-dev-samples / decode-infer-on-GPU

  View on GitHub
  This sample shows how to use the oneAPI Video Processing Library (oneVPL) to perform a single and multi-source video decode and preproces…
  ☆15Jun 15, 2023Updated 2 years ago
• sesmfs / onnx_matcher

  View on GitHub
  Using pattern matcher in onnx model to match and replace subgraphs.
  ☆81Feb 7, 2024Updated 2 years ago