Alternatives and similar repositories for multi-latent-attention

Users that are interested in multi-latent-attention are comparing it to the libraries listed below

• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆193Updated 4 months ago
• 1y33 / 100Days
  GPU Kernels
  ☆198Updated 5 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆48Updated last year
• kmohan321 / Research_Papers
  ☆46Updated 6 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆195Updated 6 months ago
• changjonathanc / flex-nano-vllm
  FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.
  ☆280Updated last month
• ThinamXx / build-GPT
  Building GPT ...
  ☆18Updated 10 months ago
• ariG23498 / fine-tune-paligemma
  Notebooks for fine tuning pali gemma
  ☆117Updated 5 months ago
• huggingface / picotron_tutorial
  ☆221Updated 7 months ago
• ariG23498 / gemma3-object-detection
  Fine tune Gemma 3 on an object detection task
  ☆84Updated 2 months ago
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆417Updated 6 months ago
• hkproj / triton-flash-attention
  ☆203Updated 9 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆86Updated 5 months ago
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆338Updated 5 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆212Updated last year
• melisa-writer / short-transformers
  Prune transformer layers
  ☆69Updated last year
• huggingface / kernels
  Load compute kernels from the Hub
  ☆290Updated last week
• mingyin0312 / RL4LLM
  RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct
  ☆30Updated 7 months ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆98Updated 6 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆83Updated last year
• cornstarch-org / Cornstarch
  ☆105Updated 3 weeks ago
• evintunador / triton_docs_tutorials
  making the official triton tutorials actually comprehensible
  ☆54Updated last month
• gpu-mode / profiling-cuda-in-torch
  ☆173Updated last year
• zaydzuhri / softpick-attention
  Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"
  ☆84Updated 3 weeks ago
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆121Updated last year
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆149Updated this week
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆242Updated last year
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆84Updated last week
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated 11 months ago
• VikParuchuri / triton_tutorial
  Tutorials for Triton, a language for writing gpu kernels
  ☆47Updated 2 years ago