Alternatives and similar repositories for fused_ops:

Users that are interested in fused_ops are comparing it to the libraries listed below

• instance-wise-ordered-transformer / IOT
  ☆20Updated 3 years ago
• CHARM-Tx / linear_mem_attention_pytorch
  Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch
  ☆12Updated 3 years ago
• HA-Transformer / MAT
  The implementation of multi-branch attentive Transformer (MAT).
  ☆33Updated 4 years ago
• gonglinyuan / StackingBERT
  Source code for "Efficient Training of BERT by Progressively Stacking"
  ☆112Updated 5 years ago
• mlpc-ucsd / BERT_Convolutions
  (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.
  ☆21Updated 2 years ago
• zomux / lanmt-ebm
  lanmt ebm
  ☆11Updated 4 years ago
• microsoft / BANG
  BANG is a new pretraining model to Bridge the gap between Autoregressive (AR) and Non-autoregressive (NAR) Generation. AR and NAR generat…
  ☆28Updated 2 years ago
• Lightning-AI / forked-pdb
  Python pdb for multiple processes
  ☆36Updated 2 years ago
• DeadAt0m / adafactor-pytorch
  A pytorch realization of adafactor (https://arxiv.org/pdf/1804.04235.pdf )
  ☆23Updated 5 years ago
• intersun / CoDIR
  Code for EMNLP 2020 paper CoDIR
  ☆41Updated 2 years ago
• XinbangZhang / DATA-NAS
  Codes for DATA: Differentiable ArchiTecture Approximation.
  ☆11Updated 3 years ago
• LiyuanLucasLiu / Torch-Scope
  A Toolkit for Training, Tracking, Saving Models and Syncing Results
  ☆60Updated 4 years ago
• jiesutd / PyTorchSequence
  ☆9Updated 6 years ago
• hypnopump / ClynMut
  To be a next-generation DL-based phenotype prediction from genome mutations.
  ☆19Updated 3 years ago
• uclaml / Padam
  Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …
  ☆39Updated last year
• layer6ai-labs / T-Fixup
  Code for the ICML'20 paper "Improving Transformer Optimization Through Better Initialization"
  ☆89Updated 3 years ago
• yzh119 / segtree-transformer-v0
  Code for SegTree Transformer (ICLR-RLGM 2019).
  ☆27Updated 5 years ago
• ShaojieJiang / tldr
  Source code repo for paper "TLDR: Token Loss Dynamic Reweighting for Reducing Repetitive Utterance Generation"
  ☆10Updated last year
• songlab-cal / mogwai
  ☆25Updated 2 years ago
• NVIDIA / dllogger
  A logging tool for deep learning.
  ☆52Updated 2 years ago
• microsoft / GEM
  ☆24Updated 3 years ago
• lucidrains / triangle-multiplicative-module
  Implementation of the Triangle Multiplicative module, used in Alphafold2 as an efficient way to mix rows or columns of a 2d feature map, …
  ☆29Updated 3 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆119Updated 3 years ago
• ofirpress / PartialShuffle
  ☆14Updated 5 years ago
• Yulv-git / Search-for-Typos
  Search for typos in code or text, automatically fix some typos. 查找文本或代码中的拼写错误/打字错误，自动修改部分 typos。【The typos lib is extensible and customiz…
  ☆9Updated last year
• MAC-AutoML / YOCO-BERT
  The official implementation of You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Natu…
  ☆48Updated 3 years ago
• SciMT / SciMT-benchmark
  ☆11Updated last year
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆61Updated 3 years ago
• LAION-AI / Conditional-Pretraining-of-Large-Language-Models
  ☆37Updated last year
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆64Updated 7 months ago