A repo for llm on ncnn
☆15Jul 5, 2026Updated 4 months ago
Alternatives and similar repositories for ncnn_llm
Users that are interested in ncnn_llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A repo for llm on ncnn☆254Oct 7, 2026Updated last month
- A lightweight heterogeneous MoE inference runtime based on ncnn☆36Updated this week
- ☆10Dec 12, 2020Updated 5 years ago
- Real time yolov8 Android demo by ncnn☆12May 6, 2025Updated last year
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆10Nov 3, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆23Jan 18, 2024Updated 2 years ago
- Tencent NCNN with added CUDA support☆70Jan 18, 2021Updated 5 years ago
- momoten is an experimental translation and runtime layer that implements a restricted, buffer-oriented subset of the Vulkan compute API o…☆27Nov 6, 2026Updated last week
- 搜藏的希望的代码片段☆13Jun 6, 2023Updated 3 years ago
- Using ncnn to test the reasoning performance of neural network☆39Jan 18, 2026Updated 10 months ago
- ☆21Oct 17, 2025Updated last year
- 使用onnxruntime部署Gaze-LLE凝视目标估计,包含C++和Python两个版本的程序☆17Jan 21, 2025Updated last year
- High-performance WebSocket streaming ASR server in Rust. Supports sherpa-onnx, FastConformer, and Parakeet models for real-time speech re…☆11Jul 17, 2026Updated 4 months ago
- 使用onnxruntime部署文档矫正,包括文档扭曲/模糊/阴影等情况,依然是包含C++和Python两个版本的程序☆17Jan 3, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Repo for PyChart 1.39, refs http://download.gna.org/pychart/☆10Sep 29, 2014Updated 12 years ago
- A tool which profiles Vulkan devices to find their peak capacities☆180Oct 21, 2026Updated 3 weeks ago
- Here I have designed a neural network with image inputs of size(300x300). The network is trained with a set of training images of fingerp…☆16Aug 7, 2020Updated 6 years ago
- ☆23Aug 20, 2025Updated last year
- Pushing the Boundaries of Few-Step Diffusion Models with Quantization-Aware Scheduling☆13Sep 3, 2025Updated last year
- Go framework for language model-powered applications with composability and chaining. Inspired by LangChain.☆12May 2, 2023Updated 3 years ago
- Easy recipes to speed up latency of Flux, QwenImage, and LTX-2 with NVFP4 and MXFP8 on Blackwell.☆14Apr 10, 2026Updated 7 months ago
- Google docs web version for Android Tablets☆11Jul 13, 2023Updated 3 years ago
- ☆13Jul 2, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This is my CUDA optimization of OpenCV seamlessClone API at NORMAL_CLONE mode.☆10Oct 29, 2023Updated 3 years ago
- a model zoo☆11Jul 19, 2017Updated 9 years ago
- **DEVELOPMENT IN PROGRESS** Example site below.... Easily deploy a collection, setup easy user minting directly here in the frontend for …☆12Jul 9, 2023Updated 3 years ago
- A MIPS CPU with dual-issue, out-of-order, and 5-stage pipelines☆12Nov 28, 2019Updated 6 years ago
- Bunraku: Turning a Single Illustration into an Editable Live2D Character☆47Jul 31, 2026Updated 3 months ago
- Sniffer,大二网络编程的课程设计☆10Feb 28, 2022Updated 4 years ago
- ☆14Mar 7, 2022Updated 4 years ago
- Unifying Academic Rigor and Industrial Scale for Responsible, Reproducible, and Efficient Recommendation☆18Nov 2, 2026Updated 2 weeks ago
- A simple tool to encrypt caffe model to deploy☆13Oct 25, 2018Updated 8 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A set of examples around MegEngine☆31Dec 8, 2023Updated 2 years ago
- This repository contains Jupyter notebooks that demonstrate how to use Netspresso to prune pre-trained deep learning models from STM32AI …☆11May 28, 2024Updated 2 years ago
- Cache Module for your NestJS applications.☆11Oct 31, 2026Updated 2 weeks ago
- Lightweight ncnn C API bindings for MicroPython☆13Dec 7, 2025Updated 11 months ago
- Official implementation of X-Slim(xslim): Accelerating diffusion model via Extreme-slimming Caching☆12Feb 25, 2026Updated 8 months ago
- ☆10Jul 28, 2021Updated 5 years ago
- Fork of Enzyme to work on Reverse-Mode Differentiation at the MLIR-level.☆11Nov 10, 2026Updated last week
Are these results useful?