Alternatives and similar repositories for jeebench:

Users that are interested in jeebench are comparing it to the libraries listed below

• kaistAI / factual-knowledge-acquisition
  ☆16Updated 6 months ago
• yash-srivastava19 / arrakis
  Arrakis is a library to conduct, track and visualize mechanistic interpretability experiments.
  ☆28Updated this week
• hgaurav2k / JEEBench
  Repository for the code and dataset for the paper: "Have LLMs Advanced enough? Towards Harder Problem Solving Benchmarks For Large Langu…
  ☆39Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• skywalker023 / fantom
  👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions"
  ☆54Updated 10 months ago
• MurtyShikhar / structural-grokking
  Code for our ACL '23 paper titled "Grokking of Hierarchical Structure in Vanilla Transformers"
  ☆21Updated last year
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆74Updated last year
• nouhadziri / faith-and-fate
  ☆34Updated last year
• allenai / MacGyver
  Code and Data for the NAACL 24 paper: MacGyver: Are Large Language Models Creative Problem Solvers?
  ☆27Updated last year
• abdulhaim / LMRL-Gym
  ☆90Updated 9 months ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆83Updated 8 months ago
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆43Updated 9 months ago
• vedantpalit / Towards-Vision-Language-Mechanistic-Interpretability
  This is the official repository for the "Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP" paper acce…
  ☆22Updated last year
• scandukuri / assistant-gate
  ☆22Updated 10 months ago
• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆36Updated 3 months ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆76Updated 5 months ago
• allenai / marg-reviewer
  Code/data for MARG (multi-agent review generation)
  ☆42Updated 5 months ago
• EleutherAI / semantic-memorization
  ☆44Updated 5 months ago
• simran-khanuja / awesome-cultural-nlp
  Resources for cultural NLP research
  ☆92Updated this week
• google-deepmind / streamingqa
  ☆46Updated last year
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆77Updated 3 years ago
• shunzh / mcts-for-llm
  This is a pip package implementing Reinforcement Learning algorithms in non-stationary environments supported by the OpenAI Gym toolkit.
  ☆14Updated 9 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 2 months ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆90Updated 2 months ago
• epfl-dlab / understanding-decoding
  The data and the PyTorch implementation for the models and experiments in the paper "Language Model Decoding as Likelihood–Utility Alignm…
  ☆14Updated last year
• google / belief-localization
  This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…
  ☆60Updated last year
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆72Updated 8 months ago
• neubig / research-career-tools
  ☆155Updated 5 months ago
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆18Updated last year
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year