A repo for llm on ncnn
☆15Jul 5, 2026Updated 3 months ago
Alternatives and similar repositories for ncnn_llm
Users that are interested in ncnn_llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A repo for llm on ncnn☆254Oct 7, 2026Updated 3 weeks ago
- ☆10Dec 12, 2020Updated 5 years ago
- Real time yolov8 Android demo by ncnn☆12May 6, 2025Updated last year
- momoten is an experimental translation and runtime layer that implements a restricted, buffer-oriented subset of the Vulkan compute API o…☆27Updated this week
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆10Nov 3, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Tencent NCNN with added CUDA support☆70Jan 18, 2021Updated 5 years ago
- A lightweight heterogeneous MoE inference runtime based on ncnn☆31Updated this week
- Using ncnn to test the reasoning performance of neural network☆39Jan 18, 2026Updated 9 months ago
- ☆21Oct 17, 2025Updated last year
- A tool which profiles Vulkan devices to find their peak capacities☆179Oct 21, 2026Updated last week
- Easy recipes to speed up latency of Flux, QwenImage, and LTX-2 with NVFP4 and MXFP8 on Blackwell.☆14Apr 10, 2026Updated 6 months ago
- Repo for PyChart 1.39, refs http://download.gna.org/pychart/☆10Sep 29, 2014Updated 12 years ago
- **DEVELOPMENT IN PROGRESS** Example site below.... Easily deploy a collection, setup easy user minting directly here in the frontend for …☆12Jul 9, 2023Updated 3 years ago
- Here I have designed a neural network with image inputs of size(300x300). The network is trained with a set of training images of fingerp…☆15Aug 7, 2020Updated 6 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆23Aug 20, 2025Updated last year
- Go framework for language model-powered applications with composability and chaining. Inspired by LangChain.☆12May 2, 2023Updated 3 years ago
- Google docs web version for Android Tablets☆11Jul 13, 2023Updated 3 years ago
- Official implementation of X-Slim(xslim): Accelerating diffusion model via Extreme-slimming Caching☆12Feb 25, 2026Updated 8 months ago
- a model zoo☆11Jul 19, 2017Updated 9 years ago
- This is my CUDA optimization of OpenCV seamlessClone API at NORMAL_CLONE mode.☆10Oct 29, 2023Updated 3 years ago
- Ulysses sequence-parallel all-to-all as a torch custom op, moved by the GPU copy engines into torch symmetric memory. Zero SM usage; 1.66…☆54Aug 25, 2026Updated 2 months ago
- OpenCV Visual Studio/Eclipse/Makefile project generator☆13Mar 3, 2016Updated 10 years ago
- A MIPS CPU with dual-issue, out-of-order, and 5-stage pipelines☆11Nov 28, 2019Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Sniffer，大二网络编程的课程设计☆10Feb 28, 2022Updated 4 years ago
- Unifying Academic Rigor and Industrial Scale for Responsible, Reproducible, and Efficient Recommendation☆18Updated this week
- An example model of a Network Processing Unit using the PFPSim framework.☆13Aug 23, 2016Updated 10 years ago
- ☆14Mar 7, 2022Updated 4 years ago
- A simple tool to encrypt caffe model to deploy☆13Oct 25, 2018Updated 8 years ago
- A set of examples around MegEngine☆31Dec 8, 2023Updated 2 years ago
- Cache Module for your NestJS applications.☆11Sep 24, 2023Updated 3 years ago
- Artifacts for ATC '22 paper "Faster Software Packet Processing on FPGA NICs with eBPF Program Warping"☆18May 20, 2022Updated 4 years ago
- A focused, native macOS system monitor for your menu bar.☆42Oct 10, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- This repository contains Jupyter notebooks that demonstrate how to use Netspresso to prune pre-trained deep learning models from STM32AI …☆11May 28, 2024Updated 2 years ago
- A rejection-sampling based distribution alignment method for extreme actor-policy mismatch RL Training☆14Feb 11, 2026Updated 8 months ago
- Lightweight ncnn C API bindings for MicroPython☆13Dec 7, 2025Updated 10 months ago
- ☆12Aug 16, 2026Updated 2 months ago
- Fork of Enzyme to work on Reverse-Mode Differentiation at the MLIR-level.☆11Apr 23, 2023Updated 3 years ago
- Abliterated DeepSeek-V4.1-Flash-1017 (FP8 dense, FP4 experts) on 4x RTX PRO 6000 with vLLM-Moet r21 and DSpark: 371-376 tok/s single-stre…☆28Updated this week
- Arrow Matrix Decomposition - Communication-Efficient Distributed Sparse Matrix Multiplication☆15Mar 25, 2024Updated 2 years ago