Alternatives and similar repositories for CATransformers

Users that are interested in CATransformers are comparing it to the libraries listed below

• RWKV / RWKV-LM
  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…
  ☆59Updated 9 months ago
• GenRobo / MatMamba
  Code and pretrained models for the paper: "MatMamba: A Matryoshka State Space Model"
  ☆62Updated last year
• facebookresearch / Mixture-of-Transformers
  Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models. TMLR 2025.
  ☆134Updated 3 months ago
• lucidrains / x-transformers-rl
  Implementation of a transformer for reinforcement learning using `x-transformers`
  ☆72Updated 3 months ago
• sayakpaul / nanoDiT
  Just another reasonably minimal repo for class-conditional training of pixel-space diffusion transformers.
  ☆142Updated 7 months ago
• EPFL-VILAB / fm-vision-evals
  ☆72Updated 5 months ago
• facebookresearch / MobileLLM-R1
  MobileLLM-R1
  ☆72Updated 3 months ago
• galilai-group / llm-jepa
  ☆154Updated 3 months ago
• lucidrains / vit-arc-slot
  Explorations into improving ViTArc with Slot Attention
  ☆43Updated last year
• lucidrains / firefly-torch
  Exploration into the Firefly algorithm in Pytorch
  ☆41Updated 10 months ago
• nvidia-cosmos / cosmos-xenna
  Python library for building and running distributed data pipelines using Ray
  ☆46Updated 3 weeks ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆137Updated 7 months ago
• apoorvkh / torchrunx
  Easily run PyTorch on multiple GPUs & machines
  ☆56Updated last month
• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆22Updated 2 years ago
• lucasjinreal / ImageTokenizer
  imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…
  ☆37Updated last year
• lucidrains / scaling-vin-pytorch
  Exploration into the Scaling Value Iteration Networks paper, from Schmidhuber's group
  ☆37Updated last year
• lucidrains / self-reasoning-tokens-pytorch
  Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
  ☆57Updated last year
• google-deepmind / tips
  TIPS (ICLR'25): Text-Image Pretraining with Spatial Awareness
  ☆111Updated 9 months ago
• MarkXCloud / CSpD
  The official repo of continuous speculative decoding
  ☆31Updated 9 months ago
• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆32Updated 10 months ago
• ChenWu98 / algorithmic-creativity
  [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction
  ☆82Updated 7 months ago
• lucidrains / multimodal-dit-pytorch
  Implementation of a multimodal diffusion transformer in Pytorch
  ☆107Updated last year
• lucidrains / spline-based-transformer
  Implementation of the proposed Spline-Based Transformer from Disney Research
  ☆105Updated last year
• NVlabs / GSPN
  [CVPR 2025] Parallel Sequence Modeling via Generalized Spatial Propagation Network
  ☆110Updated 5 months ago
• ariG23498 / mmdp
  ☆34Updated 6 months ago
• amorehead / jvp_flash_attention
  Flash Attention Triton kernel with support for second-order derivatives
  ☆129Updated 3 weeks ago
• ShadeAlsha / ICon
  ICLR 2025 - official implementation for "I-Con: A Unifying Framework for Representation Learning"
  ☆121Updated 6 months ago
• Chrixtar / SRM
  [ICML 2025] Implementation of Spatial Reasoning with Denoising Models
  ☆85Updated 5 months ago
• huggingface / pixparse
  Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data
  ☆23Updated last year
• allenai / signal-and-noise
  Measuring the Signal to Noise Ratio in Language Model Evaluation
  ☆28Updated 4 months ago