hopef / llama3_chatLinks
Llama3 Streaming Chat Sample
☆22Updated last year
Alternatives and similar repositories for llama3_chat
Users that are interested in llama3_chat are comparing it to the libraries listed below
Sorting:
- Using pattern matcher in onnx model to match and replace subgraphs.☆81Updated last year
- 搜藏的希望的代码片段☆13Updated 2 years ago
- ☆30Updated 10 months ago
- An onnx-based quantitation tool.☆71Updated last year
- 该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。☆70Updated last year
- ☆25Updated 9 months ago
- Speed up image preprocess with cuda when handle image or tensorrt inference☆77Updated last month
- ☆19Updated 3 years ago
- This is a repository to practice multi-thread programming in C++☆26Updated last year
- ☆79Updated 2 years ago
- nerf☆41Updated 3 years ago
- 跟着Tensorrt_pro学习各种知识☆40Updated 2 years ago
- ☆47Updated 2 years ago
- yolov5 tensorrt int8量化方法汇总☆82Updated last year
- 🚀🚀🚀This is an AI high-performance reasoning C++ library, Currently supports the deployment of yolov5, yolov7, yolov7-pose, yolov8, yol…☆133Updated last year
- algorithm-cpp projects☆80Updated 2 years ago
- async inference for machine learning model☆26Updated 2 years ago
- ☆114Updated last year
- Yolov5 inference on NVDec hardware decoder☆87Updated 3 years ago
- tensorrt sahi yolo 目标检测☆70Updated 2 weeks ago
- A large number of cuda/tensorrt cases . 大量案例来学习cuda/tensorrt☆151Updated 3 years ago
- YOLOv5 on Orin DLA☆212Updated last year
- 使用pycuda对图片进行预处理☆27Updated 2 years ago
- 对 tensorRT_Pro 开源项目理解☆21Updated 2 years ago
- Quantize yolov5 using pytorch_quantization.🚀🚀🚀☆14Updated last year
- 10000 fps 🚀 for 360 Surround-View CUDA Solution☆140Updated last year
- 使用TensorRT加速YOLOv8-Seg,完整的后端框架,包括Http服务器,Mysql数据库,ffmpeg视频推流等。☆86Updated last year
- 基于TensorRT的C++高性能推理库,Yolov10, YoloPv2,Yolov5/7/X/8,RT-DETR,单目标跟踪OSTrack、LightTrack。☆208Updated last year
- ☆148Updated last year
- https://github.com/shouxieai/hard_decode_trt windows编译版本☆13Updated 3 years ago