facebookresearch / language-model-plasticity
Official code for the paper Improving Language Plasticity via Pretraining with Active Forgetting, NeurIPS 2023
☆17Updated last year
Alternatives and similar repositories for language-model-plasticity:
Users that are interested in language-model-plasticity are comparing it to the libraries listed below
- ☆48Updated last year
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆42Updated last year
- Codebase for Instruction Following without Instruction Tuning☆33Updated 5 months ago
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆25Updated 10 months ago
- Tasks for describing differences between text distributions.☆16Updated 7 months ago
- The repository contains code for Adaptive Data Optimization☆20Updated 3 months ago
- ☆59Updated 10 months ago
- This is official project in our paper: Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers☆30Updated last year
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆46Updated last year
- ☆17Updated 8 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆26Updated 5 months ago
- [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages☆44Updated 3 months ago
- Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.☆25Updated last year
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆83Updated 3 months ago
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆39Updated 2 weeks ago
- ☆34Updated 11 months ago
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆65Updated 8 months ago
- [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"☆34Updated 2 months ago
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…☆59Updated last year
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Updated last year
- ☆35Updated 4 months ago
- ☆29Updated 2 months ago
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆52Updated 11 months ago
- SILO Language Models code repository☆81Updated last year
- ☆44Updated last year
- Language models scale reliably with over-training and on downstream tasks☆96Updated 11 months ago
- An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)☆30Updated 8 months ago
- ☆30Updated last year
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆72Updated 9 months ago