Alternatives and similar repositories for llama-jni

Users that are interested in llama-jni are comparing it to the libraries listed below

• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆213Updated this week
• Manuel030 / llama2.c-android
  Inference Llama 2 in one file of pure C
  ☆43Updated 2 years ago
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆90Updated last month
• yynil / RWKVinLLAMA
  ☆17Updated last year
• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆140Updated 8 months ago
• Joluck / RWKV-PEFT
  ☆165Updated this week
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆324Updated last year
• ZTMIDGO / RWKV-Android
  使用Android cpu 运行 RWKV V4 ONNX
  ☆69Updated 2 years ago
• DataXujing / Qwen1.5-0.5b-chat-android
  基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat
  ☆89Updated last year
• samolego / LocalLM
  Android app for running transformers locally using LLama.cpp & Whisper.cpp
  ☆28Updated last year
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆157Updated 2 years ago
• celikin / llama2.c-android-wrapper
  Android wrapper for Inference Llama 2 in one file of pure C
  ☆18Updated 2 years ago
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆68Updated last year
• RWKV / rwkv-onnx
  A converter and basic tester for rwkv onnx
  ☆43Updated last year
• RWKV / RWKV-infctx-trainer
  RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
  ☆148Updated last year
• TroyTzou / mlc-llm-android
  参考自mlc-llm，个人尝试在android手机上部署大模型并运行
  ☆91Updated last year
• daquexian / faster-rwkv
  ☆125Updated 2 years ago
• yuunnn-w / RWKV_Pytorch
  This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation…
  ☆132Updated last year
• MollySophia / rwkv-mobile
  Inference RWKV with multiple supported backends.
  ☆73Updated this week
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆141Updated 5 months ago
• lx200916 / ChatBotApp
  ☆41Updated 9 months ago
• mlc-ai / binary-mlc-llm-libs
  ☆281Updated last month
• tpoisonooo / llama.onnx
  LLaMa/RWKV onnx models, quantization and testcase
  ☆367Updated 2 years ago
• UbiquitousLearning / PhoneLM
  ☆66Updated last year
• mzbac / qlora-inference-multi-gpu
  ☆13Updated 2 years ago
• Abel2076 / json2binidx_tool
  ☆80Updated last year
• ssbuild / rwkv_finetuning
  rwkv finetuning
  ☆37Updated last year
• mlc-ai / relax
  ☆171Updated last week
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆614Updated last year
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆340Updated 2 months ago