This paper list focuses on the theoretical and empirical analysis of language models, especially large language models (LLMs). The papers in this list investigate the learning behavior, generalization ability, and other properties of language models through theoretical analysis, empirical analysis, or a combination of both.
☆103Jul 29, 2026Updated 3 months ago
Alternatives and similar repositories for awesome-language-model-analysis
Users that are interested in awesome-language-model-analysis are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Welcome to the 'In Context Learning Theory' Reading Group☆31Nov 8, 2024Updated 2 years ago
- [SIGIR'24] Generative Retrieval as Multi-Vector Dense Retrieval☆36Oct 18, 2024Updated 2 years ago
- This is the implementation of paper "Learning to Ask Conversational Questions by Optimizing Levenshtein Distance".☆10Jul 5, 2021Updated 5 years ago
- ☆29Feb 20, 2026Updated 8 months ago
- [ICML 2024] Code release for "On the Emergence of Cross-Task Linearity in Pretraining-Finetuning Paradigm"☆11Feb 20, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆412Oct 30, 2026Updated last week
- IR module for experimaestro☆14Updated this week
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆211Apr 13, 2026Updated 6 months ago
- Code to generate figures of paper "When do spectral gradient updates help in deep learning?"☆19Dec 3, 2025Updated 11 months ago
- ☆22Jun 11, 2024Updated 2 years ago
- A curated list of awesome Deep Learning theories that shed light on the mysteries of DL☆12Jul 20, 2018Updated 8 years ago
- [ICLR 2025 Spotlight] Code release for "Sharpness-Aware Minimization Efficiently Selects Flatter Minima Late In Training"☆20Feb 20, 2025Updated last year
- ☆247May 10, 2024Updated 2 years ago
- Code for paper ”Language Versatilists vs. Specialists: An Empirical Revisiting on Multilingual Transfer Ability“☆15Jun 13, 2023Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Code implementing the paper "Measuring intrinsic dimension of objective landscapes" to perform some research☆10Jan 26, 2023Updated 3 years ago
- ☆15Sep 21, 2022Updated 4 years ago
- This repository has been redirected into https://kuaisar.github.io/.☆11Oct 12, 2023Updated 3 years ago
- [NeurIPS 2025 Spotlight] A Token is Worth over 1,000 Tokens: Efficient Knowledge Distillation through Low-Rank Clone.☆50Oct 29, 2025Updated last year
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆308Jan 22, 2026Updated 9 months ago
- Trains Sparse Autoencoders based on outputs from language models☆11Oct 7, 2024Updated 2 years ago
- A sparse autoencoder I trained on Mistral's open source 7b model!☆10Aug 7, 2024Updated 2 years ago
- MAIR: A Massive Benchmark for Evaluating Instructed Retrieval. Evaluate your retrieval models on 126 diverse tasks. [EMNLP 2024]☆30Nov 3, 2024Updated 2 years ago
- ☆23Feb 26, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- This repo contains papers, books, tutorials and resources on Riemannian optimization.☆67Sep 11, 2026Updated last month
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆31Oct 11, 2026Updated 3 weeks ago
- DeepRAG: Thinking to Retrieve Step by Step for Large Language Models☆40Feb 17, 2026Updated 8 months ago
- ☆54May 20, 2024Updated 2 years ago
- Representation Surgery for Multi-Task Model Merging. ICML, 2024.☆51Oct 10, 2024Updated 2 years ago
- Alignment Tipping Process: How Self-Evolution Pushes LLM Agents Off the Rails☆12Oct 7, 2025Updated last year
- PyTorch implementation of the paper "Discovering and Explaining the Representation Bottleneck of DNNs" (ICLR 2022 Oral)☆37Oct 30, 2024Updated 2 years ago
- [NeurIPS 2025] Official implementation for our paper "Scaling Diffusion Transformers Efficiently via μP".☆101Nov 2, 2025Updated last year
- Curse-of-memory phenomenon of RNNs in sequence modelling☆19May 8, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- awesome papers in LLM interpretability☆628Aug 20, 2025Updated last year
- A curated list of awesome papers on dataset reduction, including dataset distillation (dataset condensation) and dataset pruning (coreset…☆62Jan 14, 2025Updated last year
- NeurIPS22 "RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection" and T-PAMI Extension☆20Feb 21, 2025Updated last year
- ☆13Sep 20, 2025Updated last year
- ☆18Jun 14, 2024Updated 2 years ago
- A curated list of resources for activation engineering☆140Oct 2, 2025Updated last year
- ☆40Feb 26, 2024Updated 2 years ago