This is the repo for the paper Shepherd -- A Critic for Language Model Generation
☆225Aug 10, 2023Updated 3 years ago
Alternatives and similar repositories for Shepherd
Users that are interested in Shepherd are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Evaluate the Quality of Critique☆37Jun 1, 2024Updated 2 years ago
- Official codebase for "SelFee: Iterative Self-Revising LLM Empowered by Self-Feedback Generation"☆226Jun 6, 2023Updated 3 years ago
- Scripts for generating synthetic finetuning data for reducing sycophancy.☆126Aug 16, 2023Updated 3 years ago
- [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…☆327Nov 11, 2023Updated 2 years ago
- Scratchpad/Chain-of-Thought Prompts☆12Jun 6, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [NeurIPS 2024] A comprehensive benchmark for evaluating critique ability of LLMs☆51Nov 29, 2024Updated last year
- A large-scale, fine-grained, diverse preference dataset (and models).☆374Dec 29, 2023Updated 2 years ago
- In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning☆34Aug 9, 2023Updated 3 years ago
- Generative Judge for Evaluating Alignment☆253Jan 18, 2024Updated 2 years ago
- Self-Alignment with Principle-Following Reward Models☆171Oct 9, 2026Updated 3 weeks ago
- Xwin-LM: Powerful, Stable, and Reproducible LLM Alignment☆1,036May 31, 2024Updated 2 years ago
- ☆283Jan 6, 2025Updated last year
- Dromedary: towards helpful, ethical and reliable LLMs.☆1,135Sep 18, 2025Updated last year
- ☆13Jul 2, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.☆844Jul 1, 2024Updated 2 years ago
- 800,000 step-level correctness labels on LLM solutions to MATH problems☆2,156Jun 1, 2023Updated 3 years ago
- ☆44Jun 2, 2024Updated 2 years ago
- Salesforce open-source LLMs with 8k sequence length.☆727Jun 2, 2026Updated 5 months ago
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"☆58Feb 29, 2024Updated 2 years ago
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆216Feb 10, 2024Updated 2 years ago
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆269Sep 12, 2024Updated 2 years ago
- Aligning Large Language Models with Human: A Survey☆739Sep 8, 2026Updated last month
- ☆338Jul 25, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"☆1,061Mar 7, 2024Updated 2 years ago
- Code for the paper <SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoning>☆46Aug 1, 2023Updated 3 years ago
- Code for Arxiv 2023: Improving Language Model Negociation with Self-Play and In-Context Learning from AI Feedback☆210May 24, 2023Updated 3 years ago
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆911Sep 30, 2025Updated last year
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆551Mar 10, 2024Updated 2 years ago
- Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"☆1,861Jun 17, 2025Updated last year
- AllenAI's post-training codebase☆3,924Updated this week
- Secrets of RLHF in Large Language Models Part I: PPO☆1,428Mar 3, 2024Updated 2 years ago
- Instruction Tuning with GPT-4☆4,333Jun 11, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆998Oct 22, 2024Updated 2 years ago
- FacTool: Factuality Detection in Generative AI☆935Aug 19, 2024Updated 2 years ago
- FeedbackQA: Improving Question Answering Post-Deployment with Interactive Feedback☆12Jul 13, 2022Updated 4 years ago
- A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)☆3,811Feb 8, 2026Updated 8 months ago
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆2,023Aug 9, 2025Updated last year
- Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"☆56Jul 3, 2023Updated 3 years ago
- ☆14May 26, 2021Updated 5 years ago