Alternatives and similar repositories for batch_invariant_ops

Users that are interested in batch_invariant_ops are comparing it to the libraries listed below

• fla-org / flame
  🔥 A minimal training framework for scaling FLA models
  ☆236Updated 3 weeks ago
• XunhaoLai / native-sparse-attention-triton
  Efficient triton implementation of Native Sparse Attention.
  ☆215Updated 3 months ago
• nil0x9 / flash-muon
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆181Updated 2 months ago
• sustcsonglin / linear-attention-and-beyond-slides
  ☆84Updated 6 months ago
• HanGuo97 / log-linear-attention
  ☆242Updated 3 months ago
• facebookresearch / PhysicsLM4
  Physics of Language Models, Part 4
  ☆242Updated last month
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆238Updated 2 weeks ago
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆140Updated this week
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆243Updated 2 months ago
• yaof20 / Flash-RL
  Implementation for FP8/INT8 Rollout for RL training without performence drop.
  ☆187Updated last week
• tilde-research / nsa-impl
  An efficient implementation of the NSA (Native Sparse Attention) kernel
  ☆114Updated 2 months ago
• xiayuqing0622 / flex_head_fa
  Fast and memory-efficient exact attention
  ☆69Updated 6 months ago
• Dao-AILab / grouped-latent-attention
  ☆124Updated 3 months ago
• MoonshotAI / checkpoint-engine
  Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
  ☆516Updated this week
• agentica-project / verl-pipeline
  Async pipelined version of Verl
  ☆116Updated 5 months ago
• huggingface / kernels
  Load compute kernels from the Hub
  ☆271Updated this week
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆129Updated 9 months ago
• jzhang38 / LongMamba
  Some preliminary explorations of Mamba's context scaling.
  ☆217Updated last year
• HazyResearch / based
  Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"
  ☆240Updated 3 months ago
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆188Updated 9 months ago
• FasterDecoding / TEAL
  ☆141Updated 6 months ago
• RulinShao / LightSeq
  Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training
  ☆216Updated last year
• PiotrNawrot / sparse-frontier
  The evaluation framework for training-free sparse attention in LLMs
  ☆91Updated 2 months ago
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆265Updated last month
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆224Updated last month
• ByteDance-Seed / FlexPrefill
  Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  ☆140Updated 3 months ago
• alexzhang13 / flashattention2-custom-mask
  Triton implementation of FlashAttention2 that adds Custom Masks.
  ☆134Updated last year
• hao-ai-lab / Consistency_LLM
  [ICML 2024] CLLMs: Consistency Large Language Models
  ☆402Updated 9 months ago
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆145Updated last year
• gpu-mode / ring-attention
  ring-attention experiments
  ☆150Updated 10 months ago