google-deepmind / loftLinks
LOFT: A 1 Million+ Token Long-Context Benchmark
☆218Updated 4 months ago
Alternatives and similar repositories for loft
Users that are interested in loft are comparing it to the libraries listed below
Sorting:
- Benchmarking LLMs with Challenging Tasks from Real Users☆242Updated 11 months ago
- The HELMET Benchmark☆178Updated 2 months ago
- Reproducible, flexible LLM evaluations☆257Updated last week
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆216Updated this week
- A simple unified framework for evaluating LLMs☆254Updated 6 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆236Updated last month
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆148Updated last year
- ☆128Updated last year
- [ICLR 2025] BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval☆169Updated last month
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆144Updated 11 months ago
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]☆108Updated 8 months ago
- ☆102Updated 11 months ago
- "Improving Mathematical Reasoning with Process Supervision" by OPENAI☆111Updated last week
- [EMNLP 2023] Adapting Language Models to Compress Long Contexts☆314Updated last year
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆204Updated last year
- Complex Function Calling Benchmark.☆139Updated 9 months ago
- The official evaluation suite and dynamic data release for MixEval.☆250Updated 11 months ago
- BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.☆215Updated last month
- ☆63Updated 8 months ago
- ☆195Updated 6 months ago
- DSIR large-scale data selection framework for language model training☆263Updated last year
- ☆239Updated last year
- Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".☆205Updated 4 months ago
- Organize the Web: Constructing Domains Enhances Pre-Training Data Curation☆67Updated 5 months ago
- Self-Alignment with Principle-Following Reward Models☆169Updated last month
- Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"☆174Updated 5 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- PASTA: Post-hoc Attention Steering for LLMs☆125Updated 11 months ago
- ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models☆186Updated last year
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆142Updated last year