Alternatives and similar repositories for fused_ops

Users that are interested in fused_ops are comparing it to the libraries listed below

• instance-wise-ordered-transformer / IOT
  ☆20Updated 4 years ago
• yanring / Megatron-MoE-ModelZoo
  Best practices for testing advanced Mixtral, DeepSeek, and Qwen series MoE models using Megatron Core MoE.
  ☆17Updated this week
• quanmingyao / SIF
  Efficient Neural Interaction Functions Search for Collaborative Filtering
  ☆18Updated 5 years ago
• CHARM-Tx / linear_mem_attention_pytorch
  Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch
  ☆12Updated 3 years ago
• mlpc-ucsd / BERT_Convolutions
  (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.
  ☆21Updated 2 years ago
• BBuf / flash-rwkv
  ☆31Updated last year
• LiyuanLucasLiu / Torch-Scope
  A Toolkit for Training, Tracking, Saving Models and Syncing Results
  ☆61Updated 5 years ago
• zomux / lanmt-ebm
  lanmt ebm
  ☆12Updated 4 years ago
• RUCAIBox / MPOP
  ☆13Updated 3 years ago
• Lightning-AI / forked-pdb
  Python pdb for multiple processes
  ☆45Updated 2 weeks ago
• NonvolatileMemory / flash_attn_gqa
  triton ver of gqa flash attn, based on the tutorial
  ☆11Updated 10 months ago
• yzh119 / segtree-transformer-v0
  Code for SegTree Transformer (ICLR-RLGM 2019).
  ☆27Updated 5 years ago
• juvi21 / CoPE-cuda
  Contextual Position Encoding but with some custom CUDA Kernels https://arxiv.org/abs/2405.18719
  ☆22Updated last year
• SciMT / SciMT-benchmark
  ☆11Updated last year
• Aleph-Alpha-Research / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated last year
• exists-forall / striped_attention
  ☆38Updated last year
• intersun / CoDIR
  Code for EMNLP 2020 paper CoDIR
  ☆41Updated 2 years ago
• gonglinyuan / StackingBERT
  Source code for "Efficient Training of BERT by Progressively Stacking"
  ☆112Updated 5 years ago
• HA-Transformer / MAT
  The implementation of multi-branch attentive Transformer (MAT).
  ☆33Updated 4 years ago
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆63Updated 3 years ago
• chentingpc / dpq_embedding_compression
  Differentiable Product Quantization for End-to-End Embedding Compression.
  ☆62Updated 2 years ago
• TsinghuaAI / TDS
  A plug-in of Microsoft DeepSpeed to fix the bug of DeepSpeed pipeline
  ☆26Updated 4 years ago
• linxihui / dkernel
  ☆20Updated last month
• rlite-project / RLite
  A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…
  ☆31Updated 2 weeks ago
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated last year
• stanford-futuredata / pytorch-distributed
  Fork of diux-dev/imagenet18
  ☆16Updated 6 years ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆43Updated 8 months ago
• fuzihaofzh / repetition-problem-nlg
  Code for the paper "A Theoretical Analysis of the Repetition Problem in Text Generation" in AAAI 2021.
  ☆54Updated 2 years ago
• lucidrains / triangle-multiplicative-module
  Implementation of the Triangle Multiplicative module, used in Alphafold2 as an efficient way to mix rows or columns of a 2d feature map, …
  ☆29Updated 3 years ago
• zhuohan123 / hint-nart
  ☆10Updated 5 years ago