Alternatives and similar repositories for mrt5

Users that are interested in mrt5 are comparing it to the libraries listed below

• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 9 months ago
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆28Updated 2 months ago
• RobertCsordas / moeut
  ☆79Updated 9 months ago
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated 9 months ago
• microsoft / encoder-decoder-slm
  Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…
  ☆27Updated 3 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆28Updated 8 months ago
• Aleph-Alpha-Research / trigrams
  ☆55Updated 3 weeks ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆128Updated 4 months ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆31Updated 2 months ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆111Updated 3 months ago
• epfml / DenseFormer
  ☆80Updated last year
• GenRobo / MatMamba
  Code and pretrained models for the paper: "MatMamba: A Matryoshka State Space Model"
  ☆59Updated 6 months ago
• allenai / infinigram-api
  ☆58Updated 2 weeks ago
• ahstat / episodic-memory-benchmark
  Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…
  ☆45Updated last month
• prateeky2806 / ComPEFT
  ☆25Updated last year
• arcee-ai / DAM
  ☆49Updated 6 months ago
• MNoorFawi / curlora
  The code repository for the CURLoRA research paper. Stable LLM continual fine-tuning and catastrophic forgetting mitigation.
  ☆44Updated 9 months ago
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆23Updated last month
• scitix / MEAP
  Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More
  ☆31Updated 2 weeks ago
• kjslag / spacebyte
  A byte-level decoder architecture that matches the performance of tokenized Transformers.
  ☆63Updated last year
• Zyphra / Zyda_processing
  ☆34Updated 11 months ago
• penfever / wildchat-50m
  Code, results and other artifacts from the paper introducing the WildChat-50m dataset and the Re-Wild model family.
  ☆29Updated 2 months ago
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 4 months ago
• neilwen987 / CSR_Adaptive_Rep
  Official Code for Paper: Beyond Matryoshka: Revisiting Sparse Coding for Adaptive Representation
  ☆67Updated last week
• Aleph-Alpha-Research / scaling
  Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…
  ☆62Updated 7 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆40Updated 7 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 10 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last year
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆26Updated 7 months ago