Alternatives and similar repositories for llama-jni

Users that are interested in llama-jni are comparing it to the libraries listed below

• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆202Updated this week
• Manuel030 / llama2.c-android
  Inference Llama 2 in one file of pure C
  ☆43Updated 2 years ago
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆88Updated last week
• NSTiwari / Llama3-on-Mobile
  This repository is an implementation of quantizing and converting the Llama3-8B-Instruct model weights and deploying it on Android for on…
  ☆73Updated last year
• TroyTzou / mlc-llm-android
  参考自mlc-llm，个人尝试在android手机上部署大模型并运行
  ☆91Updated last year
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆322Updated last year
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆159Updated 2 years ago
• yynil / RWKVinLLAMA
  ☆17Updated 11 months ago
• DataXujing / Qwen1.5-0.5b-chat-android
  基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat
  ☆85Updated last year
• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆137Updated 7 months ago
• yuunnn-w / RWKV_Pytorch
  This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation…
  ☆132Updated last year
• samolego / LocalLM
  Android app for running transformers locally using LLama.cpp & Whisper.cpp
  ☆27Updated last year
• Joluck / RWKV-PEFT
  ☆157Updated 3 weeks ago
• daquexian / faster-rwkv
  ☆125Updated last year
• ZTMIDGO / RWKV-Android
  使用Android cpu 运行 RWKV V4 ONNX
  ☆69Updated 2 years ago
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆137Updated 4 months ago
• MollySophia / rwkv-mobile
  Inference RWKV with multiple supported backends.
  ☆70Updated this week
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆68Updated last year
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆334Updated last month
• chenyangMl / llama2.c-zh
  支持中文场景的的小语言模型 llama2.c-zh
  ☆150Updated last year
• mlc-ai / relax
  ☆170Updated 3 weeks ago
• mlc-ai / binary-mlc-llm-libs
  ☆268Updated 2 weeks ago
• tpoisonooo / llama.onnx
  LLaMa/RWKV onnx models, quantization and testcase
  ☆367Updated 2 years ago
• UbiquitousLearning / PhoneLM
  ☆65Updated last year
• stevelaskaridis / awesome-mobile-llm
  Awesome Mobile LLMs
  ☆280Updated last week
• MegEngine / InferLLM
  a lightweight LLM model inference framework
  ☆744Updated last year
• yvonwin / qwen2.cpp
  qwen2 and llama3 cpp implementation
  ☆48Updated last year
• RWKV / RWKV-infctx-trainer
  RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
  ☆147Updated last year
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆610Updated last year
• wangkuiyi / huggingface-tokenizer-in-cxx
  ☆70Updated 2 years ago