alexzhang13 / Triton-Puzzles-Solutions

Related projects ⓘ

Alternatives and complementary repositories for Triton-Puzzles-Solutions

• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last month
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆40Updated last month
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆72Updated 9 months ago
• lianakoleva / no-libtorch-compile
  ☆17Updated 3 weeks ago
• emalach / LinearLM
  Code for the paper: https://arxiv.org/pdf/2309.06979.pdf
  ☆16Updated 3 months ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆35Updated 4 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆61Updated 7 months ago
• Doraemonzzz / Awesome-Triton-Resources
  Awesome Triton Resources
  ☆18Updated last month
• proger / nanokitchen
  Parallel Associative Scan for Language Models
  ☆18Updated 10 months ago
• Jokeren / triton-samples
  ☆23Updated 2 months ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆66Updated 5 months ago
• UmerHA / triton_util
  Make triton easier
  ☆41Updated 5 months ago
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆87Updated 3 months ago
• cchan / tccl
  extensible collectives library in triton
  ☆71Updated last month
• CerebrasResearch / Sparse-IFT
  Official repository of Sparse ISO-FLOP Transformations for Maximizing Training Efficiency
  ☆25Updated 3 months ago
• sustcsonglin / mamba-triton
  ☆45Updated 9 months ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆79Updated 9 months ago
• srush / prof8
  Experimental paper writing linter.
  ☆30Updated 2 months ago
• yifuwang / symm-mem-recipes
  ☆12Updated last month
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆95Updated 6 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆16Updated last week
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆29Updated 2 weeks ago
• srush / mamba-primer
  ☆35Updated 7 months ago
• srush / anynp
  Proof-of-concept of global switching between numpy/jax/pytorch in a library.
  ☆18Updated 5 months ago
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated last year
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆29Updated 6 months ago
• sustcsonglin / gated_linear_attention_layer
  ☆31Updated 10 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated 11 months ago
• sjelassi / transformers_ssm_copy
  ☆24Updated 8 months ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆44Updated 2 weeks ago