lilakk / BooookScore
A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper, "BooookScore: A systematic exploration of book-length summarization in the era of LLMs".
☆97Updated 2 weeks ago
Related projects: ⓘ
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆77Updated last month
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆118Updated 6 months ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web"☆106Updated last week
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆102Updated 2 months ago
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆159Updated 11 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆182Updated last month
- ☆62Updated 2 years ago
- ☆160Updated last year
- [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…☆82Updated 2 months ago
- ☆118Updated 5 months ago
- ☆87Updated 3 months ago
- ☆105Updated this week
- Codes for papers on Large Language Models Personalization (LaMP)☆102Updated 5 months ago
- [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners☆109Updated last week
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions☆37Updated 2 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆81Updated 2 weeks ago
- Repo for "On Learning to Summarize with Large Language Models as References"☆40Updated last year
- Implementation of the paper: "Answering Questions by Meta-Reasoning over Multiple Chains of Thought"☆89Updated 7 months ago
- PASTA: Post-hoc Attention Steering for LLMs☆96Updated last week
- Inspecting and Editing Knowledge Representations in Language Models☆105Updated last year
- Code and data for "Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data Curation" (EMNLP 2023)☆62Updated 9 months ago
- ☆114Updated 2 weeks ago
- Official implementation for the paper "LongEmbed: Extending Embedding Models for Long Context Retrieval"☆108Updated 4 months ago
- LOFT: A 1 Million+ Token Long-Context Benchmark☆127Updated 3 weeks ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆174Updated last week
- ☆32Updated 5 months ago
- [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"☆51Updated 5 months ago
- Code, datasets, and checkpoints for the paper "Improving Passage Retrieval with Zero-Shot Question Generation (EMNLP 2022)"☆91Updated last year
- [ICML 2023] Code for our paper “Compositional Exemplars for In-context Learning”.☆91Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆98Updated last year