Alternatives and similar repositories for jeebench:

Users that are interested in jeebench are comparing it to the libraries listed below

• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆55Updated 3 months ago
• google / belief-localization
  This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…
  ☆59Updated last year
• kaistAI / factual-knowledge-acquisition
  ☆17Updated 4 months ago
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆71Updated last year
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆40Updated 7 months ago
• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆35Updated last month
• abdulhaim / LMRL-Gym
  ☆78Updated 7 months ago
• skywalker023 / fantom
  👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions"
  ☆52Updated 8 months ago
• allenai / openpi-dataset
  OpenPI dataset for tracking entities in open domain procedural text
  ☆22Updated 6 months ago
• nouhadziri / faith-and-fate
  ☆34Updated 10 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆69Updated 2 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆65Updated 6 months ago
• hgaurav2k / JEEBench
  Repository for the code and dataset for the paper: "Have LLMs Advanced enough? Towards Harder Problem Solving Benchmarks For Large Langu…
  ☆39Updated last year
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆83Updated 6 months ago
• xxxiaol / QRData
  Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data
  ☆35Updated this week
• codezakh / DataEnvGym
  A testbed for agents and environments that can automatically improve models through data generation.
  ☆18Updated 2 months ago
• yash-srivastava19 / arrakis
  Arrakis is a library to conduct, track and visualize mechanistic interpretability experiments.
  ☆25Updated last week
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆32Updated 2 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆98Updated 10 months ago
• neubig / research-career-tools
  ☆154Updated 2 months ago
• EleutherAI / semantic-memorization
  ☆44Updated 3 months ago
• EagleW / Scientific-Inspiration-Machines-Optimized-for-Novelty
  Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty
  ☆74Updated 10 months ago
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆64Updated 8 months ago
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆18Updated 11 months ago
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆76Updated 2 years ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆112Updated last year
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆26Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• epfl-dlab / GCD
  ☆32Updated last year
• ZonglinY / MOOSE
  [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …
  ☆38Updated 3 months ago