shixiangcap / llama-jni
Android JNI for port of Facebook's LLaMA model in C/C++
☆22Updated last year
Alternatives and similar repositories for llama-jni:
Users that are interested in llama-jni are comparing it to the libraries listed below
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆62Updated last week
- ☆124Updated last year
- A mobile Implementation of llama.cpp☆308Updated last year
- ☆18Updated 3 months ago
- qwen2 and llama3 cpp implementation☆44Updated 10 months ago
- Inference RWKV with multiple supported backends.☆40Updated this week
- Demonstration of running a native LLM on Android device.☆129Updated last week
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆76Updated last year
- ☆119Updated last week
- A converter and basic tester for rwkv onnx☆42Updated last year
- rwkv finetuning☆36Updated last year
- This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation…☆128Updated 9 months ago
- RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!☆148Updated 8 months ago
- Script and instruction how to fine-tune large RWKV model on your data for Alpaca dataset☆31Updated 2 years ago
- export llama to onnx☆121Updated 3 months ago
- ☆65Updated 2 years ago
- Direct Preference Optimization for RWKV, aiming for RWKV-5 and 6.☆11Updated last year
- ☆12Updated last year
- This project is established for real-time training of the RWKV model.☆49Updated 11 months ago
- ☆34Updated 9 months ago
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆79Updated 3 years ago
- ☆21Updated last year
- Inference Llama 2 in one file of pure C☆42Updated last year
- [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models☆56Updated 7 months ago
- Fork of llama.cpp, extended for GPT-NeoX, RWKV-v4, and Falcon models☆29Updated last year
- A fast RWKV Tokenizer written in Rust☆44Updated 3 weeks ago
- 使用Android手机的CPU推理stable diffusion☆151Updated last year
- Port of Facebook's LLaMA model in C/C++☆92Updated this week
- llama.cpp tutorial on Android phone☆99Updated 3 weeks ago
- GLM Series Edge Models☆136Updated 2 months ago