princeton-nlp / HELMET
The HELMET Benchmark
☆143Updated 3 weeks ago
Alternatives and similar repositories for HELMET
Users that are interested in HELMET are comparing it to the libraries listed below
Sorting:
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆179Updated 2 months ago
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]☆105Updated 2 months ago
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆190Updated 9 months ago
- LOFT: A 1 Million+ Token Long-Context Benchmark☆193Updated 3 weeks ago
- SkyRL-v0: Train Real-World Long-Horizon Agents via Reinforcement Learning☆180Updated this week
- ☆171Updated 3 weeks ago
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆134Updated 7 months ago
- [NeurIPS'24 Spotlight] Observational Scaling Laws☆54Updated 7 months ago
- ☆151Updated 4 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆199Updated last week
- The official repo for "LLoCo: Learning Long Contexts Offline"☆116Updated 10 months ago
- BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval☆110Updated 3 weeks ago
- [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"☆75Updated 5 months ago
- Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…☆149Updated last month
- Long Context Extension and Generalization in LLMs☆54Updated 7 months ago
- ☆73Updated 6 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆221Updated 6 months ago
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆198Updated last week
- ☆78Updated 4 months ago
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆205Updated 11 months ago
- Reproducible, flexible LLM evaluations☆200Updated this week
- Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…☆131Updated 9 months ago
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"☆144Updated 3 weeks ago
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆135Updated 6 months ago
- General Reasoner: Advancing LLM Reasoning Across All Domains☆77Updated this week
- ☆46Updated 2 months ago
- [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning☆93Updated last week
- The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"☆53Updated last year
- BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.☆200Updated last week
- Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling☆101Updated 3 months ago