Alternatives and similar repositories for MatMamba

Users that are interested in MatMamba are comparing it to the libraries listed below

• epfml / DenseFormer
  ☆82Updated last year
• KaiNylund / lm-weights-encode-time
  ☆68Updated last year
• jkallini / mrt5
  Code repository for the paper "MrT5: Dynamic Token Merging for Efficient Byte-level Language Models."
  ☆53Updated 4 months ago
• RobertCsordas / moeut
  ☆91Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆61Updated last year
• Aleph-Alpha-Research / trigrams
  ☆59Updated 2 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆91Updated last year
• facebookresearch / mexma
  MEXMA: Token-level objectives improve sentence representations
  ☆42Updated last year
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆46Updated 3 months ago
• MaxBelitsky / cache-steering
  KV Cache Steering for Inducing Reasoning in Small Language Models
  ☆46Updated 6 months ago
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆31Updated 9 months ago
• LAGoM-NLP / transtokenizer
  ☆57Updated last month
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆103Updated last year
• minyoungg / LTE
  ☆71Updated last year
• penfever / wildchat-50m
  Code, results and other artifacts from the paper introducing the WildChat-50m dataset and the Re-Wild model family.
  ☆34Updated 10 months ago
• arcee-ai / DAM
  ☆56Updated last year
• togethercomputer / Dragonfly
  ☆80Updated last year
• lucidrains / mirasol-pytorch
  Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
  ☆91Updated 2 years ago
• jxiw / BiGS
  Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …
  ☆116Updated last year
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆186Updated last year
• lucidrains / AMIE-pytorch
  Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind
  ☆74Updated last year
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆102Updated last year
• zaydzuhri / flame
  Fork of Flame repo for training of some new stuff in development
  ☆19Updated last month
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆160Updated last year
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆57Updated last year
• huggingface / peft-pytorch-conference
  Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…
  ☆15Updated 2 years ago
• prs-eth / LoRA-Ensemble
  LoRA-Ensemble: Efficient Uncertainty Modelling for Self-attention Networks
  ☆54Updated 4 months ago
• giangdip2410 / HyperRouter
  Code for this paper "HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts via HyperNetwork"
  ☆33Updated 2 years ago
• apoorvkh / academic-pretraining
  $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources
  ☆150Updated 4 months ago
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated last year