Alternatives and similar repositories for AutoBencher:

Users that are interested in AutoBencher are comparing it to the libraries listed below

• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆29Updated 2 months ago
• PrasannS / rlhf-length-biases
  ☆27Updated last year
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 6 months ago
• shadowkiller33 / Contrast-Instruction
  ☆19Updated last year
• google / belief-localization
  This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…
  ☆59Updated last year
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆46Updated last year
• activatedgeek / calibration-tuning
  ☆47Updated 7 months ago
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆35Updated 9 months ago
• jmerullo / lm_vector_arithmetic
  ☆34Updated last year
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆44Updated last month
• milesaturpin / cot-unfaithfulness
  ☆38Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆113Updated 4 months ago
• lmarena / PPE
  ☆38Updated 4 months ago
• ruiqi-zhong / nlparam
  Augmenting Statistical Models with Natural Language Parameters
  ☆23Updated 6 months ago
• petezh / OpenD5
  Tasks for describing differences between text distributions.
  ☆16Updated 7 months ago
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆58Updated 2 years ago
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆55Updated 8 months ago
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆56Updated 6 months ago
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆42Updated last year
• abertsch72 / long-context-icl
  Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"
  ☆32Updated 7 months ago
• nouhadziri / faith-and-fate
  ☆34Updated 11 months ago
• hbin0701 / Self-Explore
  [𝐄𝐌𝐍𝐋𝐏 𝐅𝐢𝐧𝐝𝐢𝐧𝐠𝐬 𝟐𝟎𝟐𝟒 & 𝐀𝐂𝐋 𝟐𝟎𝟐𝟒 𝐍𝐋𝐑𝐒𝐄 𝐎𝐫𝐚𝐥] 𝘌𝘯𝘩𝘢𝘯𝘤𝘪𝘯𝘨 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘙𝘦𝘢𝘴𝘰𝘯𝘪𝘯…
  ☆48Updated 10 months ago
• kaistAI / factual-knowledge-acquisition
  ☆17Updated 5 months ago
• jiahai-feng / binding-iclr
  ☆12Updated last year
• saprmarks / geometry-of-truth
  ☆82Updated 7 months ago
• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆41Updated 3 months ago
• googleinterns / localizing-paragraph-memorization
  ☆12Updated last year
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆16Updated 10 months ago
• abhika-m / FAVA
  ☆68Updated last year
• tatsu-lab / linguistic_calibration
  Align your LM to express calibrated verbal statements of confidence in its long-form generations.
  ☆22Updated 9 months ago