aredden / torch-bnb-fp4

Related projects ⓘ

Alternatives and complementary repositories for torch-bnb-fp4

• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 9 months ago
• mgmalek / efficient_cross_entropy
  ☆76Updated 5 months ago
• INT-FlashAttention2024 / INT-FlashAttention
  ☆46Updated last month
• aredden / torch-cublas-hgemm
  PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu
  ☆38Updated 2 months ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆35Updated 3 months ago
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA / Triton
  ☆140Updated this week
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆66Updated 5 months ago
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆46Updated 7 months ago
• FasterDecoding / TEAL
  ☆95Updated last month
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆156Updated last year
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆43Updated last week
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆33Updated 2 years ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆46Updated this week
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆72Updated 9 months ago
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆211Updated 3 months ago
• cloneofsimo / min-fsdp
  ☆72Updated 4 months ago
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆79Updated 5 months ago
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆51Updated 2 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• timudk / flux_triton
  Writing FLUX in Triton
  ☆30Updated last month
• ai-compiler-study / triton-kernels
  Triton kernels for Flux
  ☆17Updated this week
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆91Updated last month
• ClashLuke / SOAP
  ☆19Updated this week
• LiqunMa / FBI-LLM
  FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation
  ☆45Updated 4 months ago
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆85Updated 3 weeks ago
• cloneofsimo / imagenet.int8
  ☆33Updated 6 months ago
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆105Updated last week
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆24Updated last year
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆184Updated last month
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆146Updated 11 months ago