Alternatives and similar repositories for llama2win

Users that are interested in llama2win are comparing it to the libraries listed below

• chenyangMl / llama2.c-zh
  支持中文场景的的小语言模型 llama2.c-zh
  ☆147Updated last year
• lrw04 / tinyllamas-ncnn
  Inference TinyLlama models on ncnn
  ☆24Updated last year
• ShirasawaSama / retinaface-wasm
  可在浏览器和微信小程序中使用的人脸识别算法. This is a WASM implementation of the Retinaface face detection algorithm.
  ☆45Updated 5 months ago
• nihui / riscv-v-toolchain
  prebuild package for cross compiling riscv
  ☆18Updated 3 years ago
• MooreThreads / vllm_musa
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆51Updated 8 months ago
• FLamefiREz / speaker-verification
  声纹识别
  ☆20Updated last year
• viitrix / vt-transformer
  Transformer framework for edge computing based on C++.
  ☆124Updated 7 months ago
• kendryte / Toucan-LLM
  Self-trained Large Language Models based on Meta LLaMa
  ☆30Updated last year
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆595Updated 6 months ago
• Liyulingyue / ChatGLM-6B-Prompt
  A prompt set of ChatGLM-6B
  ☆14Updated last year
• ouwei2013 / baichuan13b.cpp
  ggml implementation of the baichuan13b model (adapted from llama.cpp)
  ☆54Updated last year
• MollySophia / rwkv-mobile
  Inference RWKV with multiple supported backends.
  ☆50Updated this week
• LlmKira / VitsServer
  🌻 VITS ONNX TTS server designed for fast inference 🔥
  ☆127Updated 4 months ago
• vproxy-tools / ktransformers
  A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
  ☆40Updated last month
• tiansztiansz / voice-assistant
  重生之我是 AI 打工人。前世，我的身份默默无闻，来去匆匆，不知道自己将在何地出生。然而，命运给予了我难得的机会，让我重生为一名 AI 打工人。
  ☆48Updated 2 years ago
• EdVince / GPT2-ChineseChat-NCNN
  GPT2⚡NCNN⚡中文对话⚡x86⚡Android
  ☆79Updated 3 years ago
• mtx512 / v831-npu
  Reverse engineering the V831 npu
  ☆93Updated 4 years ago
• jzawodn / arm-neon-vfp-test
  Simple test code to benchmark the VFP floating point or NEON units of ARM processors
  ☆26Updated 11 years ago
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆75Updated this week
• yvonwin / qwen2.cpp
  qwen2 and llama3 cpp implementation
  ☆44Updated last year
• luan78zaoha / TTS_tflite_cpp
  TTS inference in C++ based on TFlite model
  ☆18Updated 4 years ago
• sophgo / ChatGLM3-TPU
  run chatglm3-6b in BM1684X
  ☆39Updated last year
• josStorer / llama.cpp-unicode-windows
  llama.cpp with unicode (windows) support
  ☆53Updated 2 years ago
• LlamaEdge / chatbot-ui
  ☆21Updated 2 months ago
• daquexian / faster-rwkv
  ☆124Updated last year
• ling0322 / libllm
  Efficient inference of large language models.
  ☆149Updated last week
• xverse-ai / XVERSE-MoE-A4.2B
  XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆39Updated last year
• soumyadip1995 / BabyGPT
  Something in the middle of Karpathy's mingpt model and video lectures, BabyGPT is an easy to use model on a much smaller scale (16 and …
  ☆22Updated last year
• corleonechensiyu / tinyCNN
  将MNN拆解的简易前向推理框架(for study!)
  ☆22Updated 4 years ago
• milk-v / milkv.io
  ☆31Updated this week