Alternatives and similar repositories for native-sparse-attention

Users that are interested in native-sparse-attention are comparing it to the libraries listed below

• hkproj / triton-flash-attention
  ☆192Updated 7 months ago
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆393Updated 5 months ago
• evintunador / triton_docs_tutorials
  making the official triton tutorials actually comprehensible
  ☆53Updated last week
• 1y33 / 100Days
  GPU Kernels
  ☆193Updated 4 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆191Updated 2 months ago
• MekkCyber / CutlassAcademy
  A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS
  ☆214Updated 3 months ago
• a-hamdi / GPU
  100 days of building GPU kernels!
  ☆492Updated 4 months ago
• HazyResearch / aisys-building-blocks
  Building blocks for foundation models.
  ☆539Updated last year
• huggingface / picotron_tutorial
  ☆214Updated 6 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆252Updated 7 months ago
• ScalingIntelligence / KernelBench
  KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems
  ☆537Updated this week
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆347Updated last year
• hkproj / 100-days-of-gpu
  ☆365Updated 4 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆181Updated 5 months ago
• gpu-mode / awesomeMLSys
  An ML Systems Onboarding list
  ☆877Updated 7 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆353Updated 2 weeks ago
• rkinas / cuda-learning
  This repository is a curated collection of resources, tutorials, and practical examples designed to guide you through the journey of mast…
  ☆377Updated 6 months ago
• NVIDIA / kvpress
  LLM KV cache compression made easy
  ☆596Updated this week
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆470Updated 6 months ago
• lessw2020 / triton_kernels_for_fun_and_profit
  Custom kernels in Triton language for accelerating LLMs
  ☆25Updated last year
• rwitten / HighPerfLLMs2024
  ☆527Updated last year
• Quentin-Anthony / nanoMPI
  Simple MPI implementation for prototyping or learning
  ☆279Updated 3 weeks ago
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆571Updated 2 weeks ago
• changjonathanc / flex-nano-vllm
  FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.
  ☆261Updated 3 weeks ago
• gpu-mode / profiling-cuda-in-torch
  ☆163Updated last year
• pranjalssh / fast.cu
  Fastest kernels written from scratch
  ☆318Updated 4 months ago
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,948Updated 9 months ago
• stanford-cs336 / spring2024-lectures
  ☆354Updated 8 months ago
• aryagxr / cuda
  coding CUDA everyday!
  ☆57Updated 4 months ago
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆136Updated last year