Alternatives and similar repositories for MGQA

Users that are interested in MGQA are comparing it to the libraries listed below

• kyegomez / Paper-Implementation-Template
  A simple reproducible template to implement AI research papers
  ☆24Updated 8 months ago
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆97Updated 8 months ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆111Updated 5 months ago
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆57Updated last year
• BestAnHongjun / SentenceVAE
  Enable Next-sentence Prediction for Large Language Models with Faster Speed, Higher Accuracy and Longer Context
  ☆32Updated 9 months ago
• sramshetty / mixture-of-depths
  An unofficial implementation of "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆35Updated 11 months ago
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆87Updated last year
• ByungKwanLee / Phantom
  [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…
  ☆60Updated 7 months ago
• kyegomez / TTL
  Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"
  ☆24Updated this week
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆55Updated 9 months ago
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆48Updated last year
• zhixuan-lin / forgetting-transformer
  [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"
  ☆104Updated 3 weeks ago
• annosubmission / GRC-Cache
  ☆16Updated 2 years ago
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆94Updated this week
• HazyResearch / prefix-linear-attention
  ☆54Updated 10 months ago
• allenai / grit_official
  Official repository for the General Robust Image Task (GRIT) Benchmark
  ☆54Updated 2 years ago
• snu-mllab / LayerMerge
  Official PyTorch implementation of "LayerMerge: Neural Network Depth Compression through Layer Pruning and Merging" (ICML 2024)
  ☆29Updated 9 months ago
• TomerRonen34 / mixed-resolution-vit
  ☆50Updated last year
• kyegomez / LIMoE
  Implementation of the "the first large-scale multimodal mixture of experts models." from the paper: "Multimodal Contrastive Learning with…
  ☆28Updated 2 months ago
• kirill-vish / Beyond-INet
  Code for experiments for "ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy"
  ☆101Updated 8 months ago
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆56Updated 5 months ago
• NVlabs / STL
  Official Pytorch Implementation of Self-emerging Token Labeling
  ☆33Updated last year
• philippe-eecs / small-vision
  A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.
  ☆35Updated 11 months ago
• MCR-PEFT / Ex-MCR
  ☆43Updated 2 weeks ago
• chijames / KERPLE
  ☆19Updated 2 years ago
• OscarXZQ / weight-selection
  ☆181Updated 8 months ago
• bfshi / TOAST
  Official code for "TOAST: Transfer Learning via Attention Steering"
  ☆188Updated last year
• kyegomez / PaLM2-VAdapter
  Implementation of "PaLM2-VAdapter:" from the multi-modal model paper: "PaLM2-VAdapter: Progressively Aligned Language Model Makes a Stron…
  ☆15Updated 6 months ago
• shaochenze / PatchTrain
  Code for paper "Patch-Level Training for Large Language Models"
  ☆86Updated 6 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆38Updated 7 months ago