Alternatives and similar repositories for MatMamba

Users that are interested in MatMamba are comparing it to the libraries listed below

• epfml / DenseFormer
  ☆82Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆61Updated last year
• MaxBelitsky / cache-steering
  KV Cache Steering for Inducing Reasoning in Small Language Models
  ☆44Updated 5 months ago
• facebookresearch / mexma
  MEXMA: Token-level objectives improve sentence representations
  ☆42Updated last year
• RobertCsordas / moeut
  ☆91Updated last year
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆103Updated last year
• jkallini / mrt5
  Code repository for the paper "MrT5: Dynamic Token Merging for Efficient Byte-level Language Models."
  ☆53Updated 3 months ago
• KaiNylund / lm-weights-encode-time
  ☆69Updated last year
• kyegomez / TTL
  Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"
  ☆25Updated 3 weeks ago
• zaydzuhri / flame
  Fork of Flame repo for training of some new stuff in development
  ☆19Updated last week
• togethercomputer / Dragonfly
  ☆80Updated last year
• ariG23498 / mmdp
  ☆34Updated 6 months ago
• elsatch / daily_hf_papers_abstracts
  This repository includes the code to download the curated HuggingFace papers into a single markdown formatted file
  ☆15Updated last year
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆46Updated 2 months ago
• lucidrains / mirasol-pytorch
  Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
  ☆91Updated 2 years ago
• Aleph-Alpha-Research / trigrams
  ☆59Updated last month
• lucidrains / mind-evolution
  Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind
  ☆58Updated 7 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆185Updated 11 months ago
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆66Updated last year
• devvrit / matformer
  MatFormer repo
  ☆68Updated last year
• parameterlab / dr-llm
  Source code of "Dr.LLM: Dynamic Layer Routing in LLMs"
  ☆40Updated 3 months ago
• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆22Updated 2 years ago
• arcee-ai / DAM
  ☆55Updated last year
• lucidrains / transformer-lm-gan
  Explorations into adversarial losses on top of autoregressive loss for language modeling
  ☆41Updated 3 weeks ago
• apoorvkh / academic-pretraining
  $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources
  ☆150Updated 3 months ago
• CERC-AAI / Robin
  ☆63Updated last year
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆132Updated 2 months ago
• lucidrains / self-reasoning-tokens-pytorch
  Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
  ☆57Updated last year
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆58Updated this week
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆90Updated last year