GAIR-NLP / scaleeval

Related projects: ⓘ

• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web"
  ☆106Updated this week
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆44Updated 8 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆45Updated 6 months ago
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆65Updated last month
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆81Updated last month
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; arXiv preprint arXiv:2403.…
  ☆34Updated 2 months ago
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆54Updated 6 months ago
• GAIR-NLP / benbench
  Benchmarking Benchmark Leakage in Large Language Models
  ☆39Updated 4 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆46Updated 5 months ago
• chujiezheng / LLM-Extrapolation
  Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"
  ☆62Updated 3 months ago
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆37Updated 2 months ago
• xlang-ai / BRIGHT
  BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆41Updated last month
• abhika-m / FAVA
  ☆52Updated 7 months ago
• OSU-NLP-Group / Fuxi
  Repository for paper Tools Are Instrumental for Language Agents in Complex Environments
  ☆32Updated 8 months ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆55Updated last week
• kaistAI / Janus
  [ACL 2024 NLP4ConvAI Oral] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system m…
  ☆33Updated 3 months ago
• GAIR-NLP / OlympicArena
  This is the official repository of the paper "OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI"
  ☆79Updated last month
• martin-wey / CodeUltraFeedback
  CodeUltraFeedback: aligning large language models to coding preferences
  ☆62Updated 2 months ago
• sail-sg / CPO
  ☆25Updated 3 months ago
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆144Updated 6 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆81Updated 2 weeks ago
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆40Updated 8 months ago
• Re-Align / just-eval
  A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.
  ☆73Updated 7 months ago
• princeton-nlp / LitSearch
  A Retrieval Benchmark for Scientific Literature Search
  ☆53Updated 2 months ago
• xxxiaol / QRData
  Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data
  ☆28Updated last month
• ars22 / scaling-LLM-math-synthetic-data
  Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"
  ☆22Updated 3 months ago
• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly"
  ☆121Updated 3 months ago
• XiangLi1999 / AutoBencher
  ☆22Updated 2 months ago
• GAIR-NLP / weak-to-strong-reasoning
  ☆46Updated 2 weeks ago
• csitfun / LogiCoT
  the instructions and demonstrations for building a formal logical reasoning capable GLM
  ☆49Updated 2 weeks ago