Alternatives and similar repositories for DoGE:

Users that are interested in DoGE are comparing it to the libraries listed below

• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆43Updated last year
• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆103Updated 10 months ago
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆19Updated 5 months ago
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆100Updated 7 months ago
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆135Updated 3 months ago
• PKU-ML / LongPPL
  ☆27Updated 2 months ago
• roeehendel / icl_task_vectors
  ☆86Updated last year
• RZFan525 / Awesome-ScalingLaws
  A curated list of awesome resources dedicated to Scaling Laws for LLMs
  ☆69Updated last year
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆56Updated 4 months ago
• ruiqi-zhong / nlparam
  Augmenting Statistical Models with Natural Language Parameters
  ☆22Updated 4 months ago
• PrasannS / rlhf-length-biases
  ☆27Updated 10 months ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆89Updated 3 years ago
• saprmarks / geometry-of-truth
  ☆75Updated 5 months ago
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆58Updated 2 months ago
• MadryLab / DsDm
  ☆46Updated last year
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆21Updated 5 months ago
• thunlp / Modularity-Analysis
  Repo for ACL2023 Findings paper "Emergent Modularity in Pre-trained Transformers"
  ☆21Updated last year
• thunlp / MoEfication
  ☆119Updated 6 months ago
• activatedgeek / calibration-tuning
  ☆43Updated 5 months ago
• fc2869 / lo-fit
  LoFiT: Localized Fine-tuning on LLM Representations
  ☆30Updated 2 weeks ago
• mmatena / model_merging
  ☆62Updated 2 years ago
• princeton-pli / LongProc
  LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation
  ☆16Updated last week
• swj0419 / in-context-pretraining
  ☆48Updated 9 months ago
• gregorbachmann / Next-Token-Failures
  ☆78Updated 10 months ago
• chujiezheng / LLM-Extrapolation
  Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"
  ☆71Updated 7 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆40Updated 4 months ago
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆66Updated 2 years ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆65Updated 10 months ago
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆15Updated last year
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆29Updated last week