Transformer framework for edge computing based on C++.
☆130Nov 11, 2024Updated last year
Alternatives and similar repositories for vt-transformer
Users that are interested in vt-transformer are comparing it to the libraries listed below
Sorting:
- ☆28Jun 30, 2025Updated 8 months ago
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- ggml学习笔记,ggml是一个机器学习的推理框架☆18Mar 24, 2024Updated last year
- ☆17Jan 1, 2024Updated 2 years ago
- ☆33Jul 23, 2024Updated last year
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated last year
- An easy way to run, test, benchmark and tune OpenCL kernel files☆24Aug 25, 2023Updated 2 years ago
- ☆23Jan 3, 2024Updated 2 years ago
- This repo consist of some experimental results on bdd100k datasets using different object detection algorithms(Faster-RCNN, FCOS, ATSS)☆11Jun 27, 2020Updated 5 years ago
- Large Language Model Onnx Inference Framework☆35Nov 25, 2025Updated 3 months ago
- ☆10Jul 18, 2024Updated last year
- convert the deep-residual-network(50, 101, 152) from caffe to mxnet☆11Aug 26, 2016Updated 9 years ago
- implementation of replicated softmax model☆13Sep 25, 2014Updated 11 years ago
- 🎉My Collections of CUDA Kernels~☆11Jun 25, 2024Updated last year
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆12Jan 9, 2024Updated 2 years ago
- Inference deployment of the llama3☆11Apr 21, 2024Updated last year
- RKNN模型推理部署模板☆24Aug 11, 2023Updated 2 years ago
- llm deploy project based onnx.☆50Oct 9, 2024Updated last year
- Physical modelling waveguide library☆10Mar 18, 2024Updated last year
- only contain face detect 、5/81 points 、face recognization models☆11Jul 9, 2020Updated 5 years ago
- Lightweight-face-detection-CenterNet☆100Apr 9, 2020Updated 5 years ago
- SAM and lama inpaint,包含QT的GUI交互界面,实现了交互式可实时显示结果的画点、画框进行SAM,然后通过进行Inpaint,具体操作看readme里的视频。☆52Jan 30, 2024Updated 2 years ago
- 分层解耦的深度学习推理引擎☆79Feb 17, 2025Updated last year
- ☆125Dec 15, 2023Updated 2 years ago
- SDK and pollen-vision tutorials for users of Reachy2☆17Jul 31, 2025Updated 7 months ago
- pose estimation code with deepstream and yolo-pose☆13Oct 14, 2022Updated 3 years ago
- A gesture recognition module trained from scratch using Pytorch, deployed with ncnn and TensorRT.☆13May 1, 2022Updated 3 years ago
- ☆34Feb 3, 2025Updated last year
- ☆54Mar 27, 2023Updated 2 years ago
- ☆25Aug 27, 2021Updated 4 years ago
- run ChatGLM2-6B in BM1684X☆49Mar 1, 2024Updated 2 years ago
- C++ implementations for various tokenizers (sentencepiece, tiktoken etc).☆49Feb 23, 2026Updated last week
- ☆30May 1, 2022Updated 3 years ago
- 用C++实现一个简单的Transformer模型。 Attention Is All You Need。☆53Mar 11, 2021Updated 4 years ago
- c++实现的clip推理,模型有一点点改动,但是不大,改动和导出模型的代码可以在readme里找到,模型文件都在Releases里,包括AX650的模型。新增支持ChineseCLIP☆31Jun 19, 2025Updated 8 months ago
- 陆续开源医疗行业的深度学习模型及数据集☆13Dec 30, 2021Updated 4 years ago
- ☆12Dec 16, 2021Updated 4 years ago
- ☆16Mar 24, 2025Updated 11 months ago
- YoloV8 segmentation NPU for the RK 3566/68/88☆18Apr 30, 2024Updated last year