Alternatives and similar repositories for Llama-LibTorch

Users that are interested in Llama-LibTorch are comparing it to the libraries listed below

• EdVince / llm-cpp
  ☆32Updated 10 months ago
• ShaYeBuHui01 / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆16Updated last year
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆37Updated 8 months ago
• wangzhaode / mnn-asr
  mnn asr demo.
  ☆19Updated 2 months ago
• daquexian / faster-rwkv
  ☆124Updated last year
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆68Updated last week
• caijixueIT / CUDA_Learning_for_Freshman
  ☆11Updated 3 months ago
• triple-Mu / HunyuanDiT-TensorRT-libtorch
  HunyuanDiT with TensorRT and libtorch
  ☆17Updated last year
• weishengying / tiny-flash-attention
  使用 cutlass 实现 flash-attention 精简版，具有教学意义
  ☆41Updated 9 months ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆42Updated last year
• MollySophia / rwkv-mobile
  Inference RWKV with multiple supported backends.
  ☆48Updated this week
• magicse / ncnn-hifi-GAN
  ncnn HiFi-GAN
  ☆26Updated 8 months ago
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆44Updated this week
• wangzhaode / mnn-tts
  mnn tts demo.
  ☆16Updated last month
• lovemefan / ggml-learning-notes
  ggml学习笔记，ggml是一个机器学习的推理框架
  ☆15Updated last year
• triple-Mu / Stable-Diffusion-TensorRT
  Stable Diffusion in TensorRT 8.5+
  ☆14Updated 2 years ago
• guoguo1314 / llama3_learn.c
  Inference deployment of the llama3
  ☆11Updated last year
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆35Updated 4 months ago
• leimao / ONNX-Python-Examples
  ONNX Python Examples
  ☆16Updated 2 years ago
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆57Updated 7 months ago
• caibucai22 / awesome-cuda
  Awesome code, projects, books, etc. related to CUDA
  ☆17Updated last month
• hpc203 / Real-Time-Frame-Interpolation-onnxrun
  使用onnxruntime部署实时视频帧插值，包含C++和Python两个版本的程序
  ☆25Updated last year
• yvonwin / qwen2.cpp
  qwen2 and llama3 cpp implementation
  ☆44Updated last year
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆19Updated last week
• weishengying / cutlass_flash_atten_fp8
  使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention
  ☆69Updated 9 months ago
• futz12 / uie_ncnn_windows
  UIE(Universal Information Extraction) infer by ncnn
  ☆12Updated 8 months ago
• morousg / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆51Updated last week
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆110Updated 8 months ago
• luliyucoordinate / flash-attention-minimal
  Flash Attention in ~100 lines of CUDA (forward pass only)
  ☆10Updated 11 months ago
• BBuf / tensorrt-llm-moe
  ☆29Updated 4 months ago