MollySophia / rwkv-mobileLinks
Inference RWKV with multiple supported backends.
☆71Updated this week
Alternatives and similar repositories for rwkv-mobile
Users that are interested in rwkv-mobile are comparing it to the libraries listed below
Sorting:
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆89Updated 3 weeks ago
- ☆125Updated 2 years ago
- ☆84Updated 2 years ago
- A converter and basic tester for rwkv onnx☆43Updated last year
- ☆160Updated last week
- qwen2 and llama3 cpp implementation☆49Updated last year
- A converter for llama2.c legacy models to ncnn models.☆79Updated 2 years ago
- This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation…☆132Updated last year
- stable diffusion using mnn☆67Updated 2 years ago
- Infere RWKV on NCNN☆49Updated last year
- A fast RWKV Tokenizer written in Rust☆54Updated 4 months ago
- llm deploy project based onnx.☆48Updated last year
- Inference TinyLlama models on ncnn☆24Updated 2 years ago
- ☆17Updated 11 months ago
- ☆33Updated last year
- Experiments with BitNet inference on CPU☆55Updated last year
- libvits-ncnn is an ncnn implementation of the VITS library that enables cross-platform GPU-accelerated speech synthesis.🎙️💻☆62Updated 2 years ago
- A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.☆184Updated 8 months ago
- Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…☆56Updated 3 months ago
- ☆78Updated last year
- Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton☆46Updated 4 months ago
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆88Updated last year
- The WorldRWKV project aims to implement training and inference across various modalities using the RWKV7 architecture. By leveraging diff…☆62Updated 2 weeks ago
- A repo for llm on ncnn☆120Updated last week
- Whisper in TensorRT-LLM☆17Updated 2 years ago
- This project is established for real-time training of the RWKV model.☆50Updated last year
- A Toolkit to Help Optimize Large Onnx Model☆162Updated 2 months ago
- RWKV in nanoGPT style☆197Updated last year
- RAG SYSTEM FOR RWKV☆51Updated last year
- Inference deployment of the llama3☆11Updated last year