Alternatives and similar repositories for AutoBencher:

Users that are interested in AutoBencher are comparing it to the libraries listed below

• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆29Updated 3 weeks ago
• activatedgeek / calibration-tuning
  ☆44Updated 6 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆46Updated last year
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆42Updated last year
• petezh / OpenD5
  Tasks for describing differences between text distributions.
  ☆16Updated 6 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆52Updated 10 months ago
• abertsch72 / long-context-icl
  Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"
  ☆31Updated 6 months ago
• kaistAI / InstructIR
  IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…
  ☆31Updated 8 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆33Updated 4 months ago
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆35Updated 8 months ago
• PKU-ML / LongPPL
  ☆27Updated 3 months ago
• EleutherAI / w2s
  ☆21Updated 4 months ago
• PrasannS / rlhf-length-biases
  ☆27Updated 11 months ago
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆20Updated 7 months ago
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 5 months ago
• nouhadziri / faith-and-fate
  ☆34Updated 10 months ago
• BunsenFeng / AbstainQA
  AbstainQA, ACL 2024
  ☆25Updated 4 months ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆74Updated last year
• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆40Updated 2 months ago
• shadowkiller33 / Contrast-Instruction
  ☆19Updated last year
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆56Updated 4 months ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆42Updated 6 months ago
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆16Updated 8 months ago
• google / belief-localization
  This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…
  ☆59Updated last year
• deeplearning-wisc / args
  ☆34Updated last year
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆65Updated 6 months ago
• lmarena / PPE
  ☆33Updated 3 months ago
• scandukuri / assistant-gate
  ☆20Updated 8 months ago
• allenai / super-benchmark
  ☆40Updated last week
• ruiqi-zhong / nlparam
  Augmenting Statistical Models with Natural Language Parameters
  ☆23Updated 5 months ago