HumanSignal / RLHF

Related projects ⓘ

Alternatives and complementary repositories for RLHF

• xfactlab / orpo
  Official repository for ORPO
  ☆421Updated 5 months ago
• glgh / awesome-llm-human-preference-datasets
  A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.
  ☆317Updated last year
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆242Updated 3 weeks ago
• huggingface / cosmopedia
  ☆451Updated 3 weeks ago
• night-chen / ToolQA
  ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …
  ☆240Updated last year
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆318Updated 10 months ago
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆431Updated 3 weeks ago
• SALT-NLP / demonstrated-feedback
  ☆112Updated last month
• karthikv792 / LLMs-Planning
  An extensible benchmark for evaluating large language models on planning
  ☆291Updated 6 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆122Updated 8 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆236Updated 4 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆64Updated last month
• ContextualAI / gritlm
  Generative Representational Instruction Tuning
  ☆567Updated this week
• CarperAI / autocrit
  A repository for transformer critique learning and generation
  ☆86Updated 11 months ago
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆114Updated this week
• princeton-nlp / ALCE
  [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627
  ☆461Updated last month
• Psycoy / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆224Updated last week
• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆744Updated this week
• zeno-ml / zeno-build
  Build, evaluate, understand, and fix LLM-based apps
  ☆485Updated 10 months ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆213Updated last year
• potsawee / selfcheckgpt
  SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
  ☆471Updated 4 months ago
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆246Updated 2 weeks ago
• jondurbin / bagel
  A bagel, with everything.
  ☆312Updated 7 months ago
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆116Updated last year
• universal-ner / universal-ner
  ☆333Updated 11 months ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆152Updated last week
• RUCAIBox / HaluEval
  This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.
  ☆410Updated 9 months ago
• ezelikman / STaR
  Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)
  ☆164Updated last year
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆118Updated last year
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆205Updated this week