daemyung / practice-triton

Related projects ⓘ

Alternatives and complementary repositories for practice-triton

• graphcore-research / pytorch-tensor-tracker
  Flexibly track outputs and grad-outputs of torch.nn.Module.
  ☆13Updated last year
• apple / ml-cross-entropy
  ☆149Updated this week
• kakaobrain / trident
  A performance library for machine learning applications.
  ☆180Updated last year
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆56Updated last month
• google-deepmind / asyncdiloco
  ☆39Updated 10 months ago
• HeegyuKim / torch-xla-SPMD
  Pytorch/XLA SPMD Test code in Google TPU
  ☆21Updated 7 months ago
• mgmalek / efficient_cross_entropy
  ☆77Updated 5 months ago
• insoochung / transformer_bcq
  BCQ tutorial for transformers
  ☆16Updated last year
• SqueezeBits / QUICK
  QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
  ☆112Updated 8 months ago
• hpcaitech / Elixir
  Elixir: Train a Large Language Model on a Small GPU Cluster
  ☆13Updated last year
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (Official Code)
  ☆135Updated last month
• snu-mllab / Context-Memory
  Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)
  ☆50Updated 7 months ago
• swsnu / aisys2023
  ☆100Updated last year
• cloneofsimo / ezmup
  Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam
  ☆68Updated 3 months ago
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆29Updated 6 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆72Updated 10 months ago
• opengear-project / GEAR
  GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM
  ☆147Updated 4 months ago
• dame-cell / Triformer
  Transformers components but in Triton
  ☆27Updated this week
• kssteven418 / BigLittleDecoder
  [NeurIPS'23] Speculative Decoding with Big Little Decoder
  ☆86Updated 9 months ago
• vedantroy / gpu_kernels
  ☆22Updated 10 months ago
• Lightning-AI / lightning-Habana
  Lightning support for Intel Habana accelerators.
  ☆25Updated this week
• tridao / flash-attention-wheels
  ☆44Updated 11 months ago
• insuhan / hyper-attn
  ☆74Updated 11 months ago
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆51Updated 2 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆61Updated 7 months ago
• shadowpa0327 / Palu
  Code for Palu: Compressing KV-Cache with Low-Rank Projection
  ☆57Updated this week
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆76Updated 2 years ago
• sustcsonglin / mamba-triton
  ☆45Updated 9 months ago
• jason9693 / ETA4LLMs
  Calculating Expected Time for training LLM.
  ☆38Updated last year