Alternatives and similar repositories for MatMamba:

Users that are interested in MatMamba are comparing it to the libraries listed below

• Aleph-Alpha / trigrams
  ☆51Updated 5 months ago
• Christina200 / Online-LoRA-official
  [WACV 2025] Official implementation of "Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation" by Xiwen Wei, Guihong L…
  ☆31Updated 3 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆36Updated 4 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆83Updated last month
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆54Updated 5 months ago
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆18Updated last month
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated 6 months ago
• qiuzh20 / RMoE
  Official implementation of RMoE (Layerwise Recurrent Router for Mixture-of-Experts)
  ☆17Updated 6 months ago
• facebookresearch / mexma
  MEXMA: Token-level objectives improve sentence representations
  ☆40Updated last month
• SriramB-98 / vit-decompose
  ☆20Updated last month
• RobertCsordas / moeut
  ☆71Updated 5 months ago
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆51Updated 5 months ago
• prateeky2806 / ComPEFT
  ☆25Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆24Updated 3 months ago
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆18Updated 11 months ago
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆50Updated 2 months ago
• EternityYW / Gemini-Commonsense-Evaluation
  Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"
  ☆35Updated last year
• kyegomez / TTL
  Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"
  ☆24Updated this week
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆52Updated 5 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated 11 months ago
• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆23Updated last year
• lucidrains / self-reasoning-tokens-pytorch
  Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
  ☆55Updated 8 months ago
• giangdip2410 / HyperRouter
  Code for this paper "HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts via HyperNetwork"
  ☆31Updated last year
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆57Updated 4 months ago
• mistralai / mistral-evals
  ☆59Updated last week
• apple / ml-rpm-bench
  ☆39Updated 6 months ago
• tianyi-lab / MoE-Embedding
  Code for "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"
  ☆43Updated 4 months ago
• google-deepmind / asyncdiloco
  ☆42Updated last year