Alternatives and similar repositories for DGT

Users that are interested in DGT are comparing it to the libraries listed below

• HazyResearch / mongoose
  A Learnable LSH Framework for Efficient NN Training
  ☆33Updated 4 years ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆47Updated last year
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• epfml / pam
  ☆16Updated last year
• spcl / sten
  Sparsity support for PyTorch
  ☆37Updated 7 months ago
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last year
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆45Updated last year
• zxytim / arithmetic-encoding-compression
  ☆11Updated 2 years ago
• srush / tangent
  Source-to-Source Debuggable Derivatives in Pure Python
  ☆15Updated last year
• IlanPrice / DCTpS
  Code for testing DCT plus Sparse (DCTpS) networks
  ☆14Updated 4 years ago
• asappresearch / flop
  Pytorch library for factorized L0-based pruning.
  ☆45Updated 2 years ago
• exists-forall / striped_attention
  ☆41Updated last year
• JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
  Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
  ☆43Updated 6 years ago
• emalach / LinearLM
  Code for the paper: https://arxiv.org/pdf/2309.06979.pdf
  ☆21Updated last year
• AndPotap / einsum-search
  ☆33Updated last year
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆80Updated last year
• DS3Lab / CocktailSGD
  ☆26Updated 2 years ago
• mlpen / LookupFFN
  ☆20Updated last year
• proger / nanokitchen
  Parallel Associative Scan for Language Models
  ☆17Updated last year
• microsoft / fnl_paper
  Factorized Neural Layers
  ☆30Updated 2 years ago
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆39Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year
• Jokeren / triton-samples
  ☆28Updated 9 months ago
• srush / LLM-Talk
  ☆52Updated last year
• vvvm23 / mezo-jax
  JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"
  ☆19Updated 2 years ago
• HazyResearch / butterfly
  Butterfly matrix multiplication in PyTorch
  ☆174Updated 2 years ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆63Updated 4 years ago
• UmerHA / triton_util
  Make triton easier
  ☆48Updated last year
• princeton-nlp / DataMUX
  [NeurIPS 2022] DataMUX: Data Multiplexing for Neural Networks
  ☆60Updated 2 years ago
• hyeon95y / SparseLinear
  A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently
  ☆51Updated last year