GAIR-NLP/auto-j external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

GAIR-NLP/auto-j

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/GAIR-NLP/auto-j)

Close

GAIR-NLP / auto-jView on GitHubMore

• External links
• Readme badge

Generative Judge for Evaluating Alignment

☆253Jan 18, 2024Updated 2 years ago

Alternatives and similar repositories for auto-j

Users that are interested in auto-j are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• GAIR-NLP / MetaCritique

  View on GitHub
  Evaluate the Quality of Critique
  ☆37Jun 1, 2024Updated 2 years ago
• GAIR-NLP / Preference-Dissection

  View on GitHub
  ☆25May 16, 2024Updated 2 years ago
• GAIR-NLP / alignment-for-honesty

  View on GitHub
  ☆77May 22, 2024Updated 2 years ago
• GAIR-NLP / BeHonest

  View on GitHub
  BeHonest: Benchmarking Honesty in Large Language Models
  ☆36Aug 15, 2024Updated 2 years ago
• GAIR-NLP / OlympicArena

  View on GitHub
  [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
  ☆106Mar 6, 2025Updated last year
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
• OpenBMB / UltraFeedback

  View on GitHub
  A large-scale, fine-grained, diverse preference dataset (and models).
  ☆370Dec 29, 2023Updated 2 years ago
• GAIR-NLP / OPO

  View on GitHub
  ☆51Mar 2, 2024Updated 2 years ago
• princeton-nlp / LLMBar

  View on GitHub
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆141Jul 8, 2024Updated 2 years ago
• GAIR-NLP / ReasonEval

  View on GitHub
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆80Oct 9, 2025Updated 10 months ago
• koalazf99 / nanoverl

  View on GitHub
  Collections of RLxLM experiments using minimal codes
  ☆14Feb 17, 2025Updated last year
• GAIR-NLP / MoPS

  View on GitHub
  [ACL 2024] Code for "MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generation"
  ☆47Jul 19, 2024Updated 2 years ago
• GAIR-NLP / abel

  View on GitHub
  SOTA Math Opensource LLM
  ☆335Dec 12, 2023Updated 2 years ago
• zhliu0106 / learning-to-refuse

  View on GitHub
  Official Implementation of "Learning to Refuse: Towards Mitigating Privacy Risks in LLMs"
  ☆10Dec 13, 2024Updated last year
• GAIR-NLP / self-improvement-reversal

  View on GitHub
  ☆13Jul 14, 2024Updated 2 years ago
• Open source password manager - Proton Pass • Ad
  Securely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
• QwenLM / online_merging_optimizers

  View on GitHub
  Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment
  ☆82Jun 19, 2024Updated 2 years ago
• allenai / FineGrainedRLHF

  View on GitHub
  ☆283Jan 6, 2025Updated last year
• GAIR-NLP / scaleeval

  View on GitHub
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆43Feb 15, 2024Updated 2 years ago
• baaivision / JudgeLM

  View on GitHub
  [ICLR 2025 Spotlight] An open-sourced LLM judge for evaluating LLM-generated answers.
  ☆441Feb 11, 2025Updated last year
• WeOpenML / PandaLM

  View on GitHub
  ☆925May 22, 2024Updated 2 years ago
• thu-coai / CritiqueLLM

  View on GitHub
  ☆148Jul 1, 2024Updated 2 years ago
• GAIR-NLP / weak-to-strong-reasoning

  View on GitHub
  ☆59Sep 2, 2024Updated 2 years ago
• GAIR-NLP / Entropy-ABF

  View on GitHub
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆83Jan 18, 2024Updated 2 years ago
• allenai / reward-bench

  View on GitHub
  RewardBench: the first evaluation tool for reward models.
  ☆734Feb 16, 2026Updated 6 months ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• GAIR-NLP / Safety-J

  View on GitHub
  Safety-J: Evaluating Safety with Critique
  ☆16Jul 28, 2024Updated 2 years ago
• GAIR-NLP / ReAlign

  View on GitHub
  Reformatted Alignment
  ☆111Sep 23, 2024Updated last year
• open-compass / CriticEval

  View on GitHub
  [NeurIPS 2024] A comprehensive benchmark for evaluating critique ability of LLMs
  ☆50Nov 29, 2024Updated last year
• GAIR-NLP / factool

  View on GitHub
  FacTool: Factuality Detection in Generative AI
  ☆933Aug 19, 2024Updated 2 years ago
• qinyiwei / InfoBench

  View on GitHub
  ☆62Aug 22, 2024Updated 2 years ago
• TIGER-AI-Lab / MAmmoTH2

  View on GitHub
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆146Oct 27, 2024Updated last year
• GAIR-NLP / ProX

  View on GitHub
  [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale
  ☆273Jul 8, 2025Updated last year
• PKU-Alignment / safe-rlhf

  View on GitHub
  Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
  ☆1,613Nov 24, 2025Updated 9 months ago
• i-Eval / FairEval

  View on GitHub
  ☆147Sep 10, 2023Updated 2 years ago
• Serverless GPU API endpoints on Runpod - Get Bonus Credits • Ad
  Skip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
• hkust-nlp / deita

  View on GitHub
  Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]
  ☆602Dec 9, 2024Updated last year
• THUDM / AlignBench

  View on GitHub
  大模型多维度中文对齐评测基准 (ACL 2024)
  ☆431Oct 25, 2025Updated 10 months ago
• GanjinZero / RRHF

  View on GitHub
  [NIPS2023] RRHF & Wombat
  ☆804Sep 22, 2023Updated 2 years ago
• tatsu-lab / alpaca_farm

  View on GitHub
  A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.
  ☆844Jul 1, 2024Updated 2 years ago
• limenlp / safer-instruct

  View on GitHub
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Feb 22, 2024Updated 2 years ago
• Re-Align / URIAL

  View on GitHub
  ☆317Jun 9, 2024Updated 2 years ago
• GAIR-NLP / daVinci-Agency

  View on GitHub
  daVinci-Agency: Unlocking Long-Horizon Agency Data-Efficiently
  ☆38Feb 4, 2026Updated 6 months ago