gau-nernst / quantized-training

Related projects ⓘ

Alternatives and complementary repositories for quantized-training

• yifuwang / symm-mem-recipes
  ☆11Updated last month
• INT-FlashAttention2024 / INT-FlashAttention
  ☆46Updated last month
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last month
• cchan / tccl
  extensible collectives library in triton
  ☆65Updated last month
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆86Updated 6 months ago
• lianakoleva / no-libtorch-compile
  ☆17Updated 2 weeks ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆46Updated this week
• alexzhang13 / Triton-Puzzles-Solutions
  Personal solutions to the Triton Puzzles
  ☆16Updated 3 months ago
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆20Updated this week
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 9 months ago
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA / Triton
  ☆140Updated this week
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆87Updated 4 months ago
• UmerHA / triton_util
  Make triton easier
  ☆41Updated 5 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆72Updated 9 months ago
• microsoft / DeepSpeed-Kernels
  ☆55Updated 5 months ago
• apple / ml-recurrent-drafter
  ☆96Updated last month
• aredden / torch-cublas-hgemm
  PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu
  ☆38Updated 2 months ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆66Updated 5 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆145Updated this week
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆98Updated 2 months ago
• iree-org / iree-jax
  ☆48Updated 3 months ago
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆35Updated 5 months ago
• Jokeren / triton-samples
  ☆23Updated 2 months ago
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆48Updated 7 months ago
• mikex86 / tritonc
  Standalone commandline CLI tool for compiling Triton kernels
  ☆15Updated 2 months ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆160Updated last week
• ezyang / tlparse
  TORCH_LOGS parser for PT2
  ☆21Updated this week
• gpu-mode / ring-attention
  ring-attention experiments
  ☆96Updated 3 weeks ago
• DS3Lab / CocktailSGD
  ☆24Updated last year