MadryLab / platinum-benchmarksLinks
☆39Updated 8 months ago
Alternatives and similar repositories for platinum-benchmarks
Users that are interested in platinum-benchmarks are comparing it to the libraries listed below
Sorting:
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"☆45Updated last year
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆76Updated last year
- some common Huggingface transformers in maximal update parametrization (µP)☆87Updated 3 years ago
- A repository for research on medium sized language models.☆77Updated last year
- ☆89Updated last year
- ☆82Updated last year
- Simple repository for training small reasoning models☆47Updated 10 months ago
- Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…☆62Updated 2 months ago
- Using FlexAttention to compute attention with different masking patterns☆47Updated last year
- Aioli: A unified optimization framework for language model data mixing☆31Updated 11 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆86Updated last year
- Language models scale reliably with over-training and on downstream tasks☆100Updated last year
- ☆59Updated last month
- EvaByte: Efficient Byte-level Language Models at Scale☆111Updated 7 months ago
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆91Updated last year
- Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"☆31Updated 6 months ago
- Minimum Description Length probing for neural network representations☆20Updated 10 months ago
- ☆55Updated last year
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year
- ☆52Updated last year
- ☆88Updated last week
- Triton Implementation of HyperAttention Algorithm☆48Updated 2 years ago
- Gemstones: A Model Suite for Multi-Faceted Scaling Laws (NeurIPS 2025)☆30Updated 2 months ago
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆93Updated last year
- ☆53Updated last year
- ☆69Updated last year
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆45Updated 2 months ago
- ☆39Updated last year
- Understanding the correlation between different LLM benchmarks☆29Updated last year