Alternatives and similar repositories for turking-bench

Users that are interested in turking-bench are comparing it to the libraries listed below

• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆36Updated last year
• shadowkiller33 / Contrast-Instruction
  ☆19Updated last year
• SALT-NLP / PopupAttack
  Code repo for the paper: Attacking Vision-Language Computer Agents via Pop-ups
  ☆43Updated 8 months ago
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆31Updated 7 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆84Updated 4 months ago
• GAIR-NLP / weak-to-strong-reasoning
  ☆59Updated last year
• SumilerGAO / SunGen
  ☆27Updated 2 years ago
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆24Updated last year
• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆37Updated 8 months ago
• princeton-nlp / PTP
  Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073
  ☆30Updated last year
• zorazrw / trove
  [ICML'24] TroVE: Inducing Verifiable and Efficient Toolboxes for Solving Programmatic Tasks
  ☆30Updated last year
• unbiarirang / Fixed-Input-Parameterization
  This repository contains the official code for the paper: "Prompt Injection: Parameterization of Fixed Inputs"
  ☆32Updated last year
• xlang-ai / icl-selective-annotation
  [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"
  ☆111Updated 2 years ago
• Zce1112zslx / IKE
  ☆41Updated last year
• Yifan-Song793 / GoodBadGreedy
  The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism
  ☆30Updated last year
• ZhaofengWu / counterfactual-evaluation
  ☆57Updated 4 months ago
• dqxiu / KAssess
  ☆14Updated last year
• CriticBench / CriticBench
  [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning
  ☆27Updated last year
• yiqingxyq / RepoST
  Code for "[COLM'25] RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testing"
  ☆21Updated 6 months ago
• chang-github-00 / LLM-Predictive-Decoding
  ☆14Updated 2 months ago
• 3B-Group / ConvRe
  🤖ConvRe🤯: An Investigation of LLMs’ Inefficacy in Understanding Converse Relations (EMNLP 2023)
  ☆23Updated last year
• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆49Updated last year
• Nanami18 / Snowballed_Hallucination
  ☆44Updated last year
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆48Updated last year
• chenhongqiao / ToolDec
  Syntax Error-Free and Generalizable Tool Use for LLMs via Finite-State Decoding
  ☆27Updated last year
• mukhal / GRACE
  [EMNLP '23] Discriminator-Guided Chain-of-Thought Reasoning
  ☆49Updated 11 months ago
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆123Updated last year
• xlang-ai / AgentTrek
  [ICLR2025 Spotlight] Agent Trajectory Synthesis via Guiding Replay with Web Tutorials
  ☆41Updated 7 months ago
• sail-sg / symbolic-instruction-tuning
  The official repository for the paper "From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction Tuning".
  ☆66Updated 2 years ago