Alternatives and similar repositories for llama-jni

Users that are interested in llama-jni are comparing it to the libraries listed below

• daquexian / faster-rwkv
  ☆124Updated last year
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆68Updated last week
• yynil / RWKVinLLAMA
  ☆18Updated 5 months ago
• MollySophia / rwkv-mobile
  Inference RWKV with multiple supported backends.
  ☆48Updated this week
• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆142Updated last week
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆311Updated last year
• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆102Updated last month
• RWKV / rwkv-onnx
  A converter and basic tester for rwkv onnx
  ☆41Updated last year
• DataXujing / Qwen1.5-0.5b-chat-android
  基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat
  ☆79Updated last year
• yvonwin / qwen2.cpp
  qwen2 and llama3 cpp implementation
  ☆44Updated last year
• Durham / RWKV-finetune-script
  Script and instruction how to fine-tune large RWKV model on your data for Alpaca dataset
  ☆31Updated 2 years ago
• Manuel030 / llama2.c-android
  Inference Llama 2 in one file of pure C
  ☆42Updated last year
• NSTiwari / Llama3-on-Mobile
  This repository is an implementation of quantizing and converting the Llama3-8B-Instruct model weights and deploying it on Android for on…
  ☆70Updated last year
• RWKV / RWKV-infctx-trainer
  RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
  ☆147Updated 9 months ago
• Abel2076 / json2binidx_tool
  ☆82Updated last year
• TroyTzou / mlc-llm-android
  参考自mlc-llm，个人尝试在android手机上部署大模型并运行
  ☆86Updated 10 months ago
• tpoisonooo / llama.onnx
  LLaMa/RWKV onnx models, quantization and testcase
  ☆363Updated last year
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆63Updated 8 months ago
• yuunnn-w / RWKV_Pytorch
  This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation…
  ☆128Updated 10 months ago
• mlc-ai / binary-mlc-llm-libs
  ☆243Updated last month
• EdVince / diffusers-ncnn
  ☆83Updated 2 years ago
• BBuf / RWKV-World-HF-Tokenizer
  ☆34Updated 10 months ago
• wejoncy / QLLM
  A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.
  ☆172Updated 2 months ago
• AniZpZ / AutoSmoothQuant
  An easy-to-use package for implementing SmoothQuant for LLMs
  ☆99Updated 2 months ago
• EdVince / llm-cpp
  ☆32Updated 10 months ago
• mlc-ai / relax
  ☆157Updated this week
• wangkuiyi / huggingface-tokenizer-in-cxx
  ☆66Updated 2 years ago
• mlc-ai / llm-perf-bench
  ☆119Updated last year
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆272Updated 2 weeks ago
• keith2018 / TinyGPT
  Tiny C++11 GPT-2 inference implementation from scratch
  ☆63Updated 2 weeks ago