dair-iitd / jeebenchLinks
JEEBench, EMNLP 2023
☆38Updated last year
Alternatives and similar repositories for jeebench
Users that are interested in jeebench are comparing it to the libraries listed below
Sorting:
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆85Updated 10 months ago
- ☆19Updated last month
- ☆25Updated last year
- Minimum Description Length probing for neural network representations☆18Updated 5 months ago
- ☆44Updated 7 months ago
- 👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions"☆55Updated last year
- Repository for the code and dataset for the paper: "Have LLMs Advanced enough? Towards Harder Problem Solving Benchmarks For Large Langu…☆39Updated last year
- The data and the PyTorch implementation for the models and experiments in the paper "Language Model Decoding as Likelihood–Utility Alignm…☆14Updated last year
- NeurIPS 2024 tutorial on LLM Inference☆45Updated 6 months ago
- Embedding Recycling for Language models☆38Updated last year
- ☆34Updated last year
- OpenPI dataset for tracking entities in open domain procedural text☆24Updated 10 months ago
- ☆164Updated 7 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated 10 months ago
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆81Updated last year
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆40Updated 3 months ago
- Dataset and benchmark for assessing LLMs in translating natural language descriptions of planning problems into PDDL☆53Updated 8 months ago
- ☆45Updated last year
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆42Updated 8 months ago
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…☆61Updated 2 years ago
- Code and Data for the NAACL 24 paper: MacGyver: Are Large Language Models Creative Problem Solvers?☆28Updated last year
- ☆83Updated 5 months ago
- ☆96Updated last year
- The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions☆70Updated 2 years ago
- ☆96Updated 11 months ago
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆43Updated 6 months ago
- Supporting code for ReCEval paper☆28Updated 9 months ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆27Updated last year
- ☆123Updated 8 months ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆48Updated last year