shixiangcap / llama-jniLinks
Android JNI for port of Facebook's LLaMA model in C/C++
☆25Updated 2 years ago
Alternatives and similar repositories for llama-jni
Users that are interested in llama-jni are comparing it to the libraries listed below
Sorting:
- Demonstration of running a native LLM on Android device.☆184Updated 3 weeks ago
- Inference Llama 2 in one file of pure C☆43Updated 2 years ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆83Updated last week
- ☆17Updated 9 months ago
- This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation…☆130Updated last year
- 使用Android cpu 运行 RWKV V4 ONNX☆69Updated 2 years ago
- 使用Android手机的CPU推理stable diffusion☆159Updated last year
- Inference RWKV with multiple supported backends.☆60Updated last week
- A converter and basic tester for rwkv onnx☆43Updated last year
- A mobile Implementation of llama.cpp☆319Updated last year
- 参考自mlc-llm,个人尝试在android手机上部署大模型并运行☆90Updated last year
- ☆124Updated last year
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆84Updated last year
- Android app for running transformers locally using LLama.cpp & Whisper.cpp☆26Updated last year
- Android wrapper for Inference Llama 2 in one file of pure C☆18Updated 2 years ago
- qwen2 and llama3 cpp implementation☆47Updated last year
- ☆256Updated last month
- ☆147Updated last month
- This repository is an implementation of quantizing and converting the Llama3-8B-Instruct model weights and deploying it on Android for on…☆71Updated last year
- RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!☆148Updated last year
- llama.cpp tutorial on Android phone☆132Updated 5 months ago
- C++ implementation of Qwen-LM☆607Updated 10 months ago
- ☆13Updated 9 months ago
- LLaMa/RWKV onnx models, quantization and testcase☆366Updated 2 years ago
- ☆81Updated last year
- 支持中文场景的的小语言模型 llama2.c-zh☆150Updated last year
- A ggml (C++) re-implementation of tortoise-tts☆190Updated last year
- rwkv finetuning☆37Updated last year
- Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…☆54Updated 2 weeks ago
- This project is established for real-time training of the RWKV model.☆49Updated last year