Alternatives and similar repositories for Superposition-Transformer

Users that are interested in Superposition-Transformer are comparing it to the libraries listed below

• MeganTj / multimodal_alignment
  ☆11Updated last month
• akhilkedia / TranformersGetStable
  [ICML 2024] Official Repository for the paper "Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models"
  ☆10Updated 10 months ago
• jiaangli / VLCA
  Do Vision and Language Models Share Concepts? A Vector Space Alignment Study
  ☆14Updated 6 months ago
• linkedin / ControlLLM
  Control LLM
  ☆14Updated last month
• atosystem / SSL_Interface
  Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024
  ☆15Updated 6 months ago
• tianyi-lab / R2-T2
  Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"
  ☆15Updated 2 months ago
• ExplainableML / sae-for-vlm
  Sparse Autoencoders Learn Monosemantic Features in Vision-Language Models
  ☆13Updated last month
• McGill-NLP / agent-reward-bench
  AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
  ☆14Updated last week
• rithiksachdev / PostASR-Correction-SLT2024
  ☆13Updated 10 months ago
• qiuzh20 / RMoE
  Official implementation of RMoE (Layerwise Recurrent Router for Mixture-of-Experts)
  ☆20Updated 9 months ago
• Jiaxin-Ye / Emo-DNA
  [ACM MM 2023] Official PyTorch implementation of "Emo-DNA: Emotion Decoupling and Alignment Learning for Cross-Corpus Speech Emotion Reco…
  ☆11Updated last year
• MLLM-Data-Contamination / MM-Detect
  This repo contains code for the paper "Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM"
  ☆13Updated last month
• kyegomez / MultiModalCrossAttn
  The open source implementation of the cross attention mechanism from the paper: "JOINTLY TRAINING LARGE AUTOREGRESSIVE MULTIMODAL MODELS"
  ☆27Updated last year
• hitz-zentroa / whisper-lm
  Add n-gram and large language model support to Whisper models.
  ☆15Updated 2 weeks ago
• tianyi-lab / C3PO
  Code for "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"
  ☆15Updated last month
• hamishivi / tess-2
  Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"
  ☆34Updated 3 months ago
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆26Updated 6 months ago
• Helw150 / levanter
  Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
  ☆14Updated 11 months ago
• piotrpiekos / MoSA
  User-friendly implementation of the Mixture-of-Sparse-Attention (MoSA). MoSA selects distinct tokens for each head with expert choice rou…
  ☆15Updated 2 weeks ago
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated 9 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆54Updated 9 months ago
• Thorin215 / FocusedAD
  Repo of FocusedAD
  ☆12Updated last month
• yale-nlp / refdpo
  ☆16Updated 9 months ago
• kyegomez / MobileVLM
  Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …
  ☆16Updated last year
• MIO-Team / MIO
  MIO: A Foundation Model on Multimodal Tokens
  ☆25Updated 5 months ago
• kyegomez / MultiQueryAttention
  This is a simple torch implementation of the high performance Multi-Query Attention
  ☆16Updated last year
• DualityRL / multi-attempt
  ☆18Updated 2 months ago
• penfever / wildchat-50m
  Code, results and other artifacts from the paper introducing the WildChat-50m dataset and the Re-Wild model family.
  ☆29Updated last month
• microsoft / x-reasoner
  X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
  ☆42Updated 2 weeks ago
• BryceZhuo / PolyCom
  The official implementation of ICLR 2025 paper "Polynomial Composition Activations: Unleashing the Dynamics of Large Language Models".
  ☆14Updated 3 weeks ago