dair-iitd / jeebench
JEEBench, EMNLP 2023
☆33Updated last year
Alternatives and similar repositories for jeebench:
Users that are interested in jeebench are comparing it to the libraries listed below
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆36Updated 2 months ago
- Repository for the code and dataset for the paper: "Have LLMs Advanced enough? Towards Harder Problem Solving Benchmarks For Large Langu…☆39Updated last year
- Dataset and benchmark for assessing LLMs in translating natural language descriptions of planning problems into PDDL☆48Updated 3 months ago
- Discovering Data-driven Hypotheses in the Wild☆51Updated 2 months ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆35Updated 3 weeks ago
- Evaluation of neuro-symbolic engines☆34Updated 5 months ago
- ☆76Updated 6 months ago
- Arrakis is a library to conduct, track and visualize mechanistic interpretability experiments.☆24Updated 3 weeks ago
- 👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions"☆52Updated 7 months ago
- ☆30Updated last year
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆66Updated last year
- Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty☆70Updated 9 months ago
- Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22☆65Updated 2 years ago
- ☆152Updated last month
- Resources for cultural NLP research☆77Updated 2 months ago
- Code and Data for the NAACL 24 paper: MacGyver: Are Large Language Models Creative Problem Solvers?☆24Updated 9 months ago
- LogiTorch is a PyTorch-based library for logical reasoning on natural language☆70Updated 4 months ago
- ☆17Updated 3 months ago
- Repo for: When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgment☆38Updated last year
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆40Updated last month
- ☆116Updated 3 months ago
- ☆29Updated 9 months ago
- ☆27Updated 2 weeks ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆64Updated 5 months ago
- Repository for the paper Stream of Search: Learning to Search in Language☆119Updated 5 months ago
- A virtual environment for developing and evaluating automated scientific discovery agents.☆117Updated last week
- Finding semantically meaningful and accurate prompts.☆46Updated last year
- About The corresponding code from our paper " REFINER: Reasoning Feedback on Intermediate Representations" (EACL 2024). Do not hesitate t…☆69Updated 10 months ago
- ☆26Updated 6 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆53Updated 10 months ago