Alternatives and similar repositories for Llama-LibTorch:

Users that are interested in Llama-LibTorch are comparing it to the libraries listed below

• EdVince / llm-cpp
  ☆32Updated 9 months ago
• wangzhaode / mnn-asr
  mnn asr demo.
  ☆16Updated last month
• Bruce-Lee-LY / cutlass_gemm
  Multiple GEMM operators are constructed with cutlass to support LLM inference.
  ☆17Updated 6 months ago
• ShaYeBuHui01 / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆15Updated last year
• magicse / ncnn-hifi-GAN
  ncnn HiFi-GAN
  ☆26Updated 6 months ago
• daquexian / faster-rwkv
  ☆124Updated last year
• jorshi / ddsp-timbre-remap
  Real-time Timbre Remapping with Differentiable DSP.
  ☆14Updated 5 months ago
• caibucai22 / awesome-cuda
  Awesome code, projects, books, etc. related to CUDA
  ☆16Updated last week
• triple-Mu / Stable-Diffusion-TensorRT
  Stable Diffusion in TensorRT 8.5+
  ☆14Updated 2 years ago
• li199603 / sgemm_with_cuda
  SGEMM optimization with cuda step by step
  ☆18Updated last year
• asigalov61 / GIGA-Piano-XL
  SOTA Piano Transformer model trained on 4.2GB of Solo Piano MIDI music
  ☆25Updated last year
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
  ☆36Updated 3 weeks ago
• caijixueIT / CUDA_Learning_for_Freshman
  ☆11Updated last month
• superkittens / libBasicSOFA
  Basic library for spatial audio SOFA files
  ☆12Updated 4 years ago
• Kikyo-16 / airgen
  Official source codes of airsep
  ☆36Updated last year
• Yuan-ManX / audio-ai-agent
  Here we will track the latest Audio AI Agent, including speech, music, sound effects, etc.
  ☆14Updated last year
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆50Updated 5 months ago
• xlite-dev / hgemm-tensorcores-mma
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆73Updated 3 weeks ago
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆36Updated 6 months ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆108Updated 7 months ago
• triple-Mu / HunyuanDiT-TensorRT-libtorch
  HunyuanDiT with TensorRT and libtorch
  ☆17Updated 11 months ago
• NaruseMioShirakana / DragonianLib
  ☆48Updated last week
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆15Updated last year
• Chtholly-Boss / swizzle
  A practical way of learning Swizzle
  ☆18Updated 2 months ago
• Zolewit / TNNdemo
  很好用的tnn classify demo
  ☆11Updated 4 years ago
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆18Updated last week
• kyegomez / Audio-xLSTMs
  Implementation of "Audio xLSTMs: Learning Self-supervised audio representations with xLSTMs" in PyTorch
  ☆18Updated this week
• supertone-inc / onnxruntime-build
  A build project for ONNX Runtime
  ☆40Updated 2 weeks ago
• flashinfer-ai / cutlass-viz
  ☆55Updated 2 weeks ago
• asigalov61 / Euterpe
  [DEPRECEATED] Multi-Instrumental Music Transformer trained on 12GB/400k MIDIs
  ☆17Updated 2 years ago