google-deepmind / loft
LOFT: A 1 Million+ Token Long-Context Benchmark
☆180Updated this week
Alternatives and similar repositories for loft:
Users that are interested in loft are comparing it to the libraries listed below
- Reproducible, flexible LLM evaluations☆176Updated 3 months ago
- ☆143Updated 3 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆218Updated 4 months ago
- The official evaluation suite and dynamic data release for MixEval.☆233Updated 4 months ago
- ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models☆179Updated 5 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆196Updated this week
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆136Updated 4 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆166Updated 2 weeks ago
- Self-Alignment with Principle-Following Reward Models☆156Updated last year
- ☆119Updated 5 months ago
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆206Updated 10 months ago
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆179Updated 7 months ago
- The HELMET Benchmark☆121Updated this week
- [EMNLP 2023] Adapting Language Models to Compress Long Contexts☆296Updated 6 months ago
- [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA☆116Updated 4 months ago
- ☆217Updated 7 months ago
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…☆118Updated 9 months ago
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆130Updated 6 months ago
- Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".☆157Updated 10 months ago
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆131Updated 4 months ago
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]☆102Updated last month
- DSIR large-scale data selection framework for language model training☆244Updated 11 months ago
- ☆156Updated 2 weeks ago
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆236Updated last year
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆454Updated last year
- BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval☆89Updated last month
- Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718☆313Updated 5 months ago
- RewardBench: the first evaluation tool for reward models.☆526Updated 3 weeks ago
- ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)☆261Updated 11 months ago
- "Improving Mathematical Reasoning with Process Supervision" by OPENAI☆108Updated 2 weeks ago