guolinke / fused_ops

Related projects: ⓘ

• instance-wise-ordered-transformer / IOT
  ☆20Updated 3 years ago
• lucidrains / protein-glm
  ☆14Updated this week
• dptech-corp / Uni-SMART
  ☆16Updated last week
• CHARM-Tx / linear_mem_attention_pytorch
  Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch
  ☆12Updated 2 years ago
• lucidrains / lie-transformer-pytorch
  Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch
  ☆87Updated 3 years ago
• jwang0306 / transformer-pytorch
  A PyTorch implementation of Transformer, experimenting with both Post-LN (Post-LayerNorm) and Pre-LN (Pre-LayerNorm).
  ☆2Updated 4 years ago
• Lightning-AI / forked-pdb
  Python pdb for multiple processes
  ☆30Updated last year
• zomux / lanmt-ebm
  lanmt ebm
  ☆11Updated 4 years ago
• lucidrains / gvp-transformer
  ☆15Updated this week
• IDEA-XL / PRESTO
  PRESTO: Progressive Pretraining Enhances Synthetic Chemistry Outcomes
  ☆16Updated 3 weeks ago
• lucidrains / coco-lm-pytorch
  Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
  ☆45Updated 3 years ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆28Updated last week
• exists-forall / striped_attention
  ☆35Updated 10 months ago
• mlpc-ucsd / BERT_Convolutions
  (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.
  ☆21Updated 2 years ago
• HA-Transformer / MAT
  The implementation of multi-branch attentive Transformer (MAT).
  ☆33Updated 4 years ago
• layer6ai-labs / T-Fixup
  Code for the ICML'20 paper "Improving Transformer Optimization Through Better Initialization"
  ☆89Updated 3 years ago
• lucidrains / se3-transformer-jax
  ☆20Updated this week
• yzh119 / segtree-transformer-v0
  Code for SegTree Transformer (ICLR-RLGM 2019).
  ☆27Updated 4 years ago
• vvvm23 / sundae
  Unofficial PyTorch implementation of "Step-unrolled Denoising Autoencoders for Text Generation"
  ☆22Updated last year
• nvidia-china-sae / WholeGraph
  ☆11Updated 3 years ago
• antofuller / configaformers
  A python library for highly configurable transformers - easing model architecture search and experimentation.
  ☆50Updated 2 years ago
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 2 years ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆50Updated 3 months ago
• ahennequ / pytorch-custom-mma
  ☆29Updated last year
• lucidrains / tranception-pytorch
  Implementation of Tranception, an attention network, paired with retrieval, that is SOTA for protein fitness prediction
  ☆31Updated 2 years ago
• MAC-AutoML / YOCO-BERT
  The official implementation of You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Natu…
  ☆48Updated 3 years ago
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆58Updated 2 years ago
• tridao / cutlass_quant
  ☆16Updated this week
• jfpuget / NVIDIA-PCQM4Mv2
  Code of the NVIDIA winning solution to the 2nd OGB-LSC at the NeurIPS 2022 challenge with dataset PCQM4Mv2
  ☆17Updated last year
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆62Updated last month