DefTruth / lite.ai.toolkit
🛠 A lite C++ toolkit: contains 100+ Awesome AI models, support MNN, NCNN, TNN, ONNXRuntime and TensorRT. 🎉🎉
☆13Updated last month
Alternatives and similar repositories for lite.ai.toolkit:
Users that are interested in lite.ai.toolkit are comparing it to the libraries listed below
- ☆84Updated 2 years ago
- ☆40Updated 2 years ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆64Updated this week
- A converter for llama2.c legacy models to ncnn models.☆87Updated last year
- simplify >2GB large onnx model☆56Updated 5 months ago
- NeRF in NCNN with c++ & vulkan☆67Updated last year
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- ☆32Updated 9 months ago
- Whisper in TensorRT-LLM☆15Updated last year
- FSANet: 1 Mb!! Head Pose Estimation with MNN、TNN and ONNXRuntime C++.☆17Updated 3 years ago
- an example of segment-anything infer by ncnn☆121Updated 2 years ago
- a naive example of LivePortrait infer by ncnn☆41Updated 9 months ago
- ☆124Updated last year
- llm deploy project based onnx.☆36Updated 6 months ago
- SAM and lama inpaint,包含QT的GUI交互界面,实现了交互式可实时显示结果的画点、画框进行SAM,然后通过进行Inpaint,具体操作看readme里的视频。☆47Updated last year
- Inference TinyLlama models on ncnn☆24Updated last year
- Large Language Model Onnx Inference Framework☆33Updated 3 months ago
- ncnn version of CodeFormer☆105Updated 2 years ago
- stable diffusion using mnn☆68Updated last year
- Demos for how to use the shared libs of Lite.AI.ToolKit🚀🚀🌟. (https://github.com/DefTruth/lite.ai.toolkit)☆7Updated 3 years ago
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆18Updated 2 months ago
- This a demo of BlazeFace infer by ncnn☆94Updated 3 years ago
- ☆25Updated 4 months ago
- ncnn android benchmark app☆85Updated 3 years ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆49Updated last year
- ☆54Updated 4 years ago
- ☆24Updated 3 years ago
- An easy way to run, test, benchmark and tune OpenCL kernel files☆23Updated last year
- c++实现的clip推理,模型有一点点改动,但是不大,改动和导出模型的代码可以在readme里找到,模型文件都在Releases里,包括AX650的模型。新增支持ChineseCLIP☆30Updated 4 months ago
- qwen2 and llama3 cpp implementation☆44Updated 11 months ago