Alternatives and similar repositories for fused_ops:

Users that are interested in fused_ops are comparing it to the libraries listed below

• instance-wise-ordered-transformer / IOT
  ☆20Updated 4 years ago
• LAION-AI / Conditional-Pretraining-of-Large-Language-Models
  ☆37Updated last year
• CHARM-Tx / linear_mem_attention_pytorch
  Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch
  ☆12Updated 3 years ago
• yzh119 / segtree-transformer-v0
  Code for SegTree Transformer (ICLR-RLGM 2019).
  ☆27Updated 5 years ago
• zomux / lanmt-ebm
  lanmt ebm
  ☆11Updated 4 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆119Updated 3 years ago
• lucidrains / lie-transformer-pytorch
  Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch
  ☆90Updated 4 years ago
• gonglinyuan / StackingBERT
  Source code for "Efficient Training of BERT by Progressively Stacking"
  ☆112Updated 5 years ago
• Quantized-GBDT / Quantized-GBDT
  ☆12Updated 2 years ago
• drcut / CPD
  a high performance system for customized-precision distributed deep learning
  ☆12Updated 4 years ago
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 2 years ago
• ahennequ / pytorch-custom-mma
  ☆29Updated 2 years ago
• mlpc-ucsd / BERT_Convolutions
  (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.
  ☆21Updated 2 years ago
• layer6ai-labs / T-Fixup
  Code for the ICML'20 paper "Improving Transformer Optimization Through Better Initialization"
  ☆88Updated 4 years ago
• lucidrains / triangle-multiplicative-module
  Implementation of the Triangle Multiplicative module, used in Alphafold2 as an efficient way to mix rows or columns of a 2d feature map, …
  ☆29Updated 3 years ago
• HA-Transformer / MAT
  The implementation of multi-branch attentive Transformer (MAT).
  ☆33Updated 4 years ago
• MAC-AutoML / YOCO-BERT
  The official implementation of You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Natu…
  ☆48Updated 3 years ago
• iKernels / transformers-lightning
  A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transfor…
  ☆47Updated last year
• Aleph-Alpha / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated last year
• VITA-Group / EarlyBERT
  [ACL-IJCNLP 2021] "EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets" by Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, …
  ☆18Updated 3 years ago
• LCS2-IIITD / TransEvolve
  ☆11Updated 3 years ago
• dptech-corp / Uni-Core
  an efficient distributed PyTorch framework
  ☆131Updated 2 weeks ago
• dptech-corp / Uni-Fold-jax
  Trainable AlphaFold implementation in JAX
  ☆159Updated 2 years ago
• juvi21 / CoPE-cuda
  Contextual Position Encoding but with some custom CUDA Kernels https://arxiv.org/abs/2405.18719
  ☆22Updated 9 months ago
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 3 years ago
• LiyuanLucasLiu / Torch-Scope
  A Toolkit for Training, Tracking, Saving Models and Syncing Results
  ☆60Updated 5 years ago
• IDEA-XL / PRESTO
  PRESTO: Progressive Pretraining Enhances Synthetic Chemistry Outcomes [EMNLP 2024]
  ☆25Updated 4 months ago
• IBM / PoWER-BERT
  Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Pro…
  ☆61Updated 2 years ago
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆60Updated 2 years ago
• Lightning-AI / forked-pdb
  Python pdb for multiple processes
  ☆38Updated 2 years ago