shixiangcap / llama-jniLinks
Android JNI for port of Facebook's LLaMA model in C/C++
☆25Updated 2 years ago
Alternatives and similar repositories for llama-jni
Users that are interested in llama-jni are comparing it to the libraries listed below
Sorting:
- Inference Llama 2 in one file of pure C☆43Updated 2 years ago
- A mobile Implementation of llama.cpp☆320Updated last year
- A converter and basic tester for rwkv onnx☆42Updated last year
- ☆17Updated 9 months ago
- Demonstration of running a native LLM on Android device.☆191Updated last month
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆85Updated this week
- This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation…☆130Updated last year
- Android wrapper for Inference Llama 2 in one file of pure C☆18Updated 2 years ago
- ☆150Updated this week
- ☆124Updated last year
- ☆13Updated 2 years ago
- llama.cpp tutorial on Android phone☆134Updated 5 months ago
- RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!☆147Updated last year
- Inference RWKV with multiple supported backends.☆62Updated this week
- 使用Android cpu 运行 RWKV V4 ONNX☆68Updated 2 years ago
- Enhancing LangChain prompts to work better with RWKV models☆34Updated 2 years ago
- This project is established for real-time training of the RWKV model.☆49Updated last year
- [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models☆68Updated last year
- Train your own small bitnet model☆75Updated last year
- Step by step explanation/tutorial of llama2.c☆224Updated 2 years ago
- IRIS is an android app for interfacing with GGUF / llama.cpp models locally.☆237Updated 8 months ago
- Android app for running transformers locally using LLama.cpp & Whisper.cpp☆26Updated last year
- Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.☆52Updated 2 years ago
- The paddle implementation of meta's LLaMA.☆45Updated 2 years ago
- LLaMa/RWKV onnx models, quantization and testcase☆367Updated 2 years ago
- ☆62Updated 11 months ago
- 演示Gemma中文指令微调的 教程☆46Updated last year
- 参考自mlc-llm,个人尝试在android手机上部署大模型并运行☆90Updated last year
- High-speed and easy-use LLM serving framework for local deployment☆130Updated 2 months ago
- Family of instruction-following LLMs powered by Evol-Instruct: WizardLM, WizardCoder☆44Updated last year