rogerallen / llama2.cu

Related projects ⓘ

Alternatives and complementary repositories for llama2.cu

• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆86Updated 6 months ago
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆35Updated 6 months ago
• run-ai / llmperf
  ☆46Updated last month
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆143Updated this week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆145Updated this week
• apple / ml-recurrent-drafter
  ☆96Updated last month
• mlc-ai / llm-perf-bench
  ☆114Updated 6 months ago
• ColfaxResearch / cfx-article-src
  ☆47Updated 2 weeks ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆160Updated last week
• nod-ai / SHARK-ModelDev
  Unified compiler/runtime for interfacing with PyTorch Dynamo.
  ☆95Updated this week
• ColfaxResearch / cutlass-kernels
  ☆162Updated 4 months ago
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆196Updated 2 weeks ago
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA / Triton
  ☆140Updated this week
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆40Updated this week
• iree-org / iree-turbine
  IREE's PyTorch Frontend, based on Torch Dynamo.
  ☆53Updated this week
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆87Updated 4 months ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆98Updated 2 months ago
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆47Updated 4 months ago
• mmperf / mmperf
  MatMul Performance Benchmarks for a Single CPU Core comparing both hand engineered and codegen kernels.
  ☆123Updated last year
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆410Updated this week
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆133Updated 2 months ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆46Updated this week
• neuralmagic / AutoFP8
  ☆156Updated last month
• sgl-project / sgl-learning-materials
  Materials for learning SGLang
  ☆86Updated this week
• intel / auto-round
  Advanced Quantization Algorithm for LLMs. This is official implementation of "Optimize Weight Rounding via Signed Gradient Descent for t…
  ☆245Updated this week
• cchan / tccl
  extensible collectives library in triton
  ☆65Updated last month
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆63Updated 2 weeks ago
• microsoft / triton-shared
  Shared Middle-Layer for Triton Compilation
  ☆188Updated this week
• NVIDIA / Fuser
  A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
  ☆268Updated this week
• amd / ZenDNN
  ☆83Updated 5 months ago
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆93Updated this week