pytorch-labs / superblock

Related projects ⓘ

Alternatives and complementary repositories for superblock

• mgmalek / efficient_cross_entropy
  ☆76Updated 5 months ago
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆211Updated 3 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆71Updated 9 months ago
• INT-FlashAttention2024 / INT-FlashAttention
  ☆45Updated last month
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆105Updated this week
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 9 months ago
• stanford-futuredata / stk
  ☆88Updated 2 months ago
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA / Triton
  ☆137Updated this week
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆66Updated 5 months ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆35Updated 3 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆144Updated this week
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆56Updated 3 weeks ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆156Updated last year
• cchan / tccl
  extensible collectives library in triton
  ☆63Updated last month
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated last month
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆160Updated last week
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆43Updated last year
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆59Updated 7 months ago
• NVIDIA / Megatron-Energon
  Megatron's multi-modal data loader
  ☆130Updated this week
• FasterDecoding / TEAL
  ☆95Updated last month
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆51Updated 2 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆24Updated last year
• apple / ml-recurrent-drafter
  ☆96Updated last month
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆132Updated 2 months ago
• tridao / flash-attention-wheels
  ☆41Updated 11 months ago
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆184Updated last month
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆63Updated last week
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆184Updated last month
• epfml / dynamic-sparse-flash-attention
  ☆132Updated last year
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆40Updated last month