Alternatives and similar repositories for mrt5

Users that are interested in mrt5 are comparing it to the libraries listed below

• microsoft / encoder-decoder-slm
  Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…
  ☆27Updated 4 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 9 months ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆33Updated 3 months ago
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated 10 months ago
• arcee-ai / DAM
  ☆51Updated 7 months ago
• ahstat / episodic-memory-benchmark
  Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…
  ☆45Updated 2 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆133Updated 5 months ago
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆28Updated 3 months ago
• RobertCsordas / moeut
  ☆79Updated 10 months ago
• LAGoM-NLP / transtokenizer
  ☆48Updated 5 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆40Updated 8 months ago
• Aleph-Alpha-Research / trigrams
  ☆56Updated last month
• RWKV / RWKV-LM
  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…
  ☆47Updated 3 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 11 months ago
• allenai / infinigram-api
  ☆61Updated 3 weeks ago
• prateeky2806 / ComPEFT
  ☆25Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆74Updated 7 months ago
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆25Updated 7 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆28Updated 9 months ago
• epfml / DenseFormer
  ☆81Updated last year
• Zyphra / Zyda_processing
  ☆35Updated last year
• GenRobo / MatMamba
  Code and pretrained models for the paper: "MatMamba: A Matryoshka State Space Model"
  ☆59Updated 7 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 9 months ago
• bminixhofer / tokenkit
  A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.
  ☆27Updated last month
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated last year
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆32Updated 3 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆47Updated 4 months ago
• LLM360 / k2-train
  ☆50Updated last year
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆80Updated last year
• dmis-lab / Monet
  [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers
  ☆69Updated this week