Alternatives and similar repositories for fastforward

Users that are interested in fastforward are comparing it to the libraries listed below

• meta-pytorch / superblock
  A block oriented training approach for inference time optimization.
  ☆34Updated last year
• nil0x9 / flash-muon
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆233Updated 7 months ago
• facebookresearch / any4
  Quantize transformers to any learned arbitrary 4-bit numeric format
  ☆50Updated 2 weeks ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆115Updated last year
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆160Updated 2 years ago
• meta-pytorch / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆227Updated last year
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆26Updated 6 months ago
• meta-pytorch / tritonparse
  TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels
  ☆194Updated this week
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆83Updated 2 years ago
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆133Updated 7 months ago
• meta-pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆182Updated last month
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆57Updated 3 years ago
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆48Updated last year
• Qualcomm-AI-research / FP8-quantization
  ☆169Updated 2 years ago
• vllm-project / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆244Updated this week
• open-lm-engine / accelerated-model-architectures
  A bunch of kernels that might make stuff slower 😉
  ☆75Updated this week
• NVIDIA / jaxpp
  JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training
  ☆64Updated 3 weeks ago
• NX-AI / flashrnn
  FlashRNN - Fast RNN Kernels with I/O Awareness
  ☆174Updated 3 months ago
• UmerHA / triton_util
  Make triton easier
  ☆50Updated last year
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆82Updated 2 years ago
• thib-s / flash-newton-schulz
  My attempt to improve the speed of the newton schulz algorithm, starting from the dion implementation.
  ☆29Updated 2 months ago
• Qualcomm-AI-research / transformer-quantization
  ☆208Updated 4 years ago
• GATECH-EIC / SuperTickets
  [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning
  ☆20Updated 3 years ago
• Intelligent-Computing-Lab-Panda / GPTAQ
  Code implementation of GPTAQ (https://arxiv.org/abs/2504.02692)
  ☆81Updated 6 months ago
• lernapparat / torchhacks
  Hacks for PyTorch
  ☆19Updated 2 years ago
• meta-pytorch / torchfix
  TorchFix - a linter for PyTorch-using code with autofix support
  ☆152Updated 5 months ago
• pytorch / helion
  A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.
  ☆739Updated this week
• NVlabs / vibetensor
  Our first fully AI generated deep learning system
  ☆481Updated last week
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆95Updated last year
• HazyResearch / flash-fft-conv
  FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores
  ☆341Updated last year