UmerHA / triton_util

Related projects ⓘ

Alternatives and complementary repositories for triton_util

• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆44Updated 2 weeks ago
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last month
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆66Updated 5 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆72Updated 9 months ago
• lianakoleva / no-libtorch-compile
  ☆17Updated 3 weeks ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆56Updated last month
• cloneofsimo / min-fsdp
  ☆73Updated 4 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated 11 months ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 10 months ago
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆29Updated 2 weeks ago
• joey00072 / microjax
  Jax like function transformation engine but micro, microjax
  ☆26Updated 3 weeks ago
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆56Updated last month
• mag- / gpu_benchmark
  Gpu benchmark
  ☆43Updated last month
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆61Updated 7 months ago
• srush / LLM-Talk
  ☆45Updated 9 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆40Updated last month
• google-deepmind / asyncdiloco
  ☆39Updated 10 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed
  ☆34Updated this week
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆39Updated 4 months ago
• Zyphra / Zyda_processing
  ☆27Updated 5 months ago
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆87Updated 3 months ago
• YuchenJin / llm.c
  LLM training in simple, raw C/CUDA
  ☆12Updated last month
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆35Updated 4 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆45Updated 2 months ago
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆29Updated 6 months ago
• mikex86 / tritonc
  Standalone commandline CLI tool for compiling Triton kernels
  ☆15Updated 2 months ago
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆35Updated 11 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆104Updated last month
• alexzhang13 / Triton-Puzzles-Solutions
  Personal solutions to the Triton Puzzles
  ☆16Updated 4 months ago
• haileyschoelkopf / triton-index
  See https://github.com/cuda-mode/triton-index/ instead!
  ☆11Updated 6 months ago