Alternatives and similar repositories for dr-llm

Users that are interested in dr-llm are comparing it to the libraries listed below

• mlfoundations / dataset2metadata
  ☆26Updated last year
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated 4 months ago
• locuslab / scaling_laws_data_filtering
  ☆65Updated last year
• simran-arora / focus
  This repo contains code for the paper: "Can Foundation Models Help Us Achieve Perfect Secrecy?"
  ☆24Updated 2 years ago
• RAIVNLab / MatFormer-OLMo
  Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…
  ☆28Updated last year
• prateeky2806 / ComPEFT
  ☆26Updated last year
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated 2 years ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆78Updated 2 years ago
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆31Updated 2 years ago
• stanford-crfm / helm-efficiency
  ☆10Updated last year
• sanyalsunny111 / Early_Weight_Avg
  [COLM 2024] Early Weight Averaging meets High Learning Rates for LLM Pre-training
  ☆17Updated last year
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆55Updated last year
• hadasah / btm
  ☆76Updated last year
• nverma1 / merging-text-transformers
  Code for "Merging Text Transformers from Different Initializations"
  ☆19Updated 8 months ago
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆37Updated 2 years ago
• RAIVNLab / LLC
  ☆14Updated 4 years ago
• facebookresearch / mexma
  MEXMA: Token-level objectives improve sentence representations
  ☆42Updated 9 months ago
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆48Updated 7 months ago
• uiuctml / MergeBench
  [NeurIPS 2025] MergeBench: A Benchmark for Merging Domain-Specialized LLMs
  ☆31Updated last month
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆56Updated last year
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 3 years ago
• facebookresearch / coocmap
  code for paper "Accessing higher dimensions for unsupervised word translation"
  ☆21Updated 2 years ago
• LAION-AI / Conditional-Pretraining-of-Large-Language-Models
  ☆37Updated 2 years ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆55Updated 2 years ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆55Updated 8 months ago
• MadryLab / datamodels-data
  Data for "Datamodels: Predicting Predictions with Training Data"
  ☆97Updated 2 years ago
• CyndxAI / QKNorm
  Code for the paper "Query-Key Normalization for Transformers"
  ☆49Updated 4 years ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆31Updated 2 years ago
• mshukor / eP-ALM
  [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.
  ☆27Updated 2 years ago