Alternatives and similar repositories for DGT

Users that are interested in DGT are comparing it to the libraries listed below

• AndPotap / einsum-search
  ☆33Updated last year
• HazyResearch / mongoose
  A Learnable LSH Framework for Efficient NN Training
  ☆32Updated 4 years ago
• srush / tangent
  Source-to-Source Debuggable Derivatives in Pure Python
  ☆15Updated last year
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆45Updated last year
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last year
• proger / nanokitchen
  Parallel Associative Scan for Language Models
  ☆18Updated last year
• emalach / LinearLM
  Code for the paper: https://arxiv.org/pdf/2309.06979.pdf
  ☆21Updated last year
• miskcoo / kscore
  Nonparametric Score Estimators, ICML 2020
  ☆36Updated 4 years ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year
• UmerHA / triton_util
  Make triton easier
  ☆47Updated last year
• DS3Lab / CocktailSGD
  ☆26Updated 2 years ago
• ermongroup / SPN_Variational_Inference
  PyTorch implementation for "Probabilistic Circuits for Variational Inference in Discrete Graphical Models", NeurIPS 2020
  ☆17Updated 3 years ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆45Updated last year
• petuum / tuun
  Hyperparameter tuning via uncertainty modeling
  ☆48Updated last year
• aws-neuron / aws-neuron-reference-for-megatron-lm
  ☆14Updated 2 years ago
• alexzhang13 / Triton-Puzzles-Solutions
  Personal solutions to the Triton Puzzles
  ☆20Updated last year
• google-deepmind / dks
  Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…
  ☆72Updated 3 months ago
• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆90Updated this week
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆81Updated last year
• zomux / lanmt-ebm
  lanmt ebm
  ☆12Updated 5 years ago
• lchen001 / HAPI
  ☆17Updated 2 years ago
• TalSchuster / CATs
  Confident Adaptive Transformers
  ☆13Updated 4 years ago
• stanford-crfm / helm-efficiency
  ☆10Updated last year
• IlanPrice / DCTpS
  Code for testing DCT plus Sparse (DCTpS) networks
  ☆14Updated 4 years ago
• sjunhongshen / DASH
  ☆23Updated 2 years ago
• sustcsonglin / gated_linear_attention_layer
  ☆31Updated last year
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆40Updated last year
• ryoungj / mcbits
  [ICML'21 Oral] Improving Lossless Compression Rates via Monte Carlo Bits-Back Coding
  ☆14Updated 4 years ago
• vvvm23 / mezo-jax
  JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"
  ☆19Updated 2 years ago