Alternatives and similar repositories for fused_ops

Users that are interested in fused_ops are comparing it to the libraries listed below

• instance-wise-ordered-transformer / IOT
  ☆20Updated 4 years ago
• mlpc-ucsd / BERT_Convolutions
  (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.
  ☆21Updated 3 years ago
• LAION-AI / Conditional-Pretraining-of-Large-Language-Models
  ☆37Updated 2 years ago
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆87Updated 2 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆120Updated 4 years ago
• MAC-AutoML / YOCO-BERT
  The official implementation of You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Natu…
  ☆48Updated 4 years ago
• Alab-NII / Awesome-SciLM
  Pre-trained Language Model for Scientific Text
  ☆46Updated last year
• NVIDIA / dllogger
  A logging tool for deep learning.
  ☆60Updated 7 months ago
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆65Updated 4 years ago
• CHARM-Tx / linear_mem_attention_pytorch
  Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch
  ☆12Updated 3 years ago
• LiyuanLucasLiu / Torch-Scope
  A Toolkit for Training, Tracking, Saving Models and Syncing Results
  ☆62Updated 5 years ago
• cheneydon / efficient-bert
  This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …
  ☆33Updated 2 years ago
• gonglinyuan / StackingBERT
  Source code for "Efficient Training of BERT by Progressively Stacking"
  ☆113Updated 6 years ago
• bojone / univae
  基于Transformer的单模型、多尺度的VAE模型
  ☆57Updated 4 years ago
• MicPie / clasp
  CLASP - Contrastive Language-Aminoacid Sequence Pretraining
  ☆143Updated 4 years ago
• lucidrains / lie-transformer-pytorch
  Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch
  ☆96Updated 4 years ago
• microsoft / DualLearning
  A dual learning toolkit developed by Microsoft Research
  ☆71Updated 2 years ago
• layer6ai-labs / T-Fixup
  Code for the ICML'20 paper "Improving Transformer Optimization Through Better Initialization"
  ☆89Updated 4 years ago
• IDEA-XL / PRESTO
  PRESTO: Progressive Pretraining Enhances Synthetic Chemistry Outcomes [EMNLP 2024]
  ☆28Updated 11 months ago
• bojone / tiger
  A Tight-fisted Optimizer
  ☆50Updated 2 years ago
• dptech-corp / Uni-SMART
  ☆50Updated last year
• DeadAt0m / adafactor-pytorch
  A pytorch realization of adafactor (https://arxiv.org/pdf/1804.04235.pdf )
  ☆24Updated 6 years ago
• SciMT / SciMT-benchmark
  ☆11Updated last year
• Lightning-AI / forked-pdb
  Python pdb for multiple processes
  ☆60Updated 5 months ago
• lucidrains / triangle-multiplicative-module
  Implementation of the Triangle Multiplicative module, used in Alphafold2 as an efficient way to mix rows or columns of a 2d feature map, …
  ☆37Updated 4 years ago
• lucidrains / equiformer-diffusion
  Implementation of Denoising Diffusion for protein design, but using the new Equiformer (successor to SE3 Transformers) with some addition…
  ☆56Updated 2 years ago
• ziplab / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆30Updated last year
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆117Updated last year
• quanmingyao / SIF
  Efficient Neural Interaction Functions Search for Collaborative Filtering
  ☆18Updated 5 years ago
• XinbangZhang / DATA-NAS
  Codes for DATA: Differentiable ArchiTecture Approximation.
  ☆11Updated 4 years ago