kaistAI / FLASK
[ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
☆210Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for FLASK
- [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…☆286Updated 11 months ago
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆212Updated last year
- Benchmarking LLMs with Challenging Tasks from Real Users☆194Updated last week
- Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".☆156Updated 6 months ago
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆211Updated last year
- ☆262Updated 10 months ago
- Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering☆142Updated 3 weeks ago
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆239Updated last year
- [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners☆111Updated last month
- Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467☆264Updated last year
- [EMNLP 2023] Adapting Language Models to Compress Long Contexts☆275Updated 2 months ago
- ☆169Updated last year
- Chain-of-Hindsight, A Scalable RLHF Method☆218Updated last year
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆114Updated last month
- Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"☆258Updated 9 months ago
- Code accompanying "How I learned to start worrying about prompt formatting".☆92Updated last month
- A Survey on Data Selection for Language Models☆178Updated 3 weeks ago
- RewardBench: the first evaluation tool for reward models.☆424Updated 2 weeks ago
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆463Updated last month
- ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)☆233Updated 6 months ago
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆159Updated last year
- Benchmarking library for RAG☆112Updated this week
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆122Updated 7 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆116Updated 3 weeks ago
- A set of utilities for running few-shot prompting experiments on large-language models☆112Updated last year
- [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.☆140Updated last year
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆315Updated 10 months ago
- MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents [EMNLP 2024]☆100Updated 3 weeks ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆143Updated 8 months ago
- LOFT: A 1 Million+ Token Long-Context Benchmark☆138Updated last week