☆90Jun 30, 2023Updated 2 years ago
Alternatives and similar repositories for ChatGLM2-6B-TensorRT
Users that are interested in ChatGLM2-6B-TensorRT are comparing it to the libraries listed below
Sorting:
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Aug 16, 2023Updated 2 years ago
- ☆26Aug 15, 2023Updated 2 years ago
- Another ChatGLM2 implementation for GPTQ quantization☆55Oct 15, 2023Updated 2 years ago
- NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that del…☆26Jul 21, 2023Updated 2 years ago
- Whisper in TensorRT-LLM☆17Sep 21, 2023Updated 2 years ago
- A CUDA kernel for NHWC GroupNorm for PyTorch☆23Nov 15, 2024Updated last year
- A tool convert TensorRT engine/plan to a fake onnx☆41Nov 22, 2022Updated 3 years ago
- Inference deployment of the llama3☆11Apr 21, 2024Updated last year
- trt-hackathon-2022 三等奖方案☆10Mar 6, 2023Updated 2 years ago
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated last year
- For 2022 Nvidia Hackathon☆22Jun 28, 2022Updated 3 years ago
- ☆33Jul 23, 2024Updated last year
- FastSAM 部署版本，便于移植不同平，部署简单、运行速度快。☆24May 30, 2024Updated last year
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- 使用TensorRT加速YOLOv8-Seg，完整的后端框架，包括Http服务器，Mysql数据库，ffmpeg视频推流等。☆88Oct 9, 2023Updated 2 years ago
- Stable Diffusion in TensorRT 8.5+☆15Mar 19, 2023Updated 2 years ago
- 陆续开源医疗行业的深度学习模型及数据集☆13Dec 30, 2021Updated 4 years ago
- 搜藏的希望的代码片段☆13Jun 6, 2023Updated 2 years ago
- ☆79May 16, 2023Updated 2 years ago
- ☆57Aug 21, 2023Updated 2 years ago
- Yolov5 inference on NVDec hardware decoder☆90Nov 6, 2021Updated 4 years ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Feb 20, 2026Updated last week
- 本仓库在OpenVINO推理框架下部署Nanodet检测算法，并重写预处理和后处理部分，具有超高性能！让你在Intel CPU平台上的检测速度起飞！ 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度，推理速度更快！☆16Jun 14, 2023Updated 2 years ago
- segmentation algorithm yolact use tensorrt deploy☆14May 7, 2022Updated 3 years ago
- 基于curl的minio cpp sdk，实现上传下载和创建bucket，查询bucket等操作。简单好用☆49Dec 14, 2021Updated 4 years ago
- Accelerating SAHI-based inference on YOLO models using TensorRT.☆93Jan 6, 2026Updated last month
- SAM and lama inpaint，包含QT的GUI交互界面，实现了交互式可实时显示结果的画点、画框进行SAM，然后通过进行Inpaint，具体操作看readme里的视频。☆52Jan 30, 2024Updated 2 years ago
- An onnx-based quantitation tool.☆71Jan 8, 2024Updated 2 years ago
- fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型，单并发20tps；INT4量化模型单并发30tp…☆4,161Updated this week
- stable diffusion using mnn☆67Sep 28, 2023Updated 2 years ago
- Rank-consistent Oridinal Regression☆17Dec 24, 2019Updated 6 years ago
- stable diffusion, controlnet, tensorrt, accelerate☆58Apr 28, 2023Updated 2 years ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆114Sep 10, 2024Updated last year
- 使用LoRA对Chinese-LLaMA-Alpaca进行微调。☆35May 26, 2023Updated 2 years ago
- ☆70Dec 9, 2022Updated 3 years ago
- An easy way to run, test, benchmark and tune OpenCL kernel files☆24Aug 25, 2023Updated 2 years ago
- Using pattern matcher in onnx model to match and replace subgraphs.☆81Feb 7, 2024Updated 2 years ago
- 使用OpenCV部署L2CS-Net人脸朝向估计，包含C++和Python两个版本的程序，只依赖opencv库就可以运行☆21Aug 12, 2023Updated 2 years ago
- ☆20Dec 29, 2023Updated 2 years ago