Alternatives and similar repositories for turking-bench:

Users that are interested in turking-bench are comparing it to the libraries listed below

• SALT-NLP / PopupAttack
  Code repo for the paper: Attacking Vision-Language Computer Agents via Pop-ups
  ☆27Updated 3 months ago
• shadowkiller33 / Contrast-Instruction
  ☆19Updated last year
• SumilerGAO / SunGen
  ☆25Updated 2 years ago
• GAIR-NLP / weak-to-strong-reasoning
  ☆59Updated 6 months ago
• RenzeLou / Muffin
  MUFFIN: Curating Multi-Faceted Instructions for Improving Instruction-Following
  ☆15Updated 4 months ago
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 6 months ago
• XiangLi1999 / AutoBencher
  ☆26Updated 8 months ago
• dannyallover / overthinking_the_truth
  ☆29Updated 10 months ago
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆39Updated 2 years ago
• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆36Updated 2 months ago
• KbsdJames / omni-math-rule
  The rule-based evaluation subset and code implementation of Omni-MATH
  ☆17Updated 3 months ago
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆29Updated 2 months ago
• yiqingxyq / RepoST
  Code for "RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testing"
  ☆16Updated last week
• chang-github-00 / LLM-Predictive-Decoding
  ☆12Updated 4 months ago
• abertsch72 / long-context-icl
  Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"
  ☆34Updated 7 months ago
• archiki / ReCEval
  Supporting code for ReCEval paper
  ☆28Updated 6 months ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆77Updated last year
• zorazrw / trove
  [ICML'24] TroVE: Inducing Verifiable and Efficient Toolboxes for Solving Programmatic Tasks
  ☆25Updated 6 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• nouhadziri / faith-and-fate
  ☆34Updated 11 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆46Updated last year
• HKUNLP / critic-rl
  Code for Paper: Teaching Language Models to Critique via Reinforcement Learning
  ☆84Updated last month
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆75Updated 2 months ago
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆20Updated 8 months ago
• ruiqi-zhong / nlparam
  Augmenting Statistical Models with Natural Language Parameters
  ☆23Updated 6 months ago
• Reason-Wang / NAT
  The official implementation of paper "Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as Agen…
  ☆24Updated last year
• neulab / data-agora
  [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"
  ☆34Updated 3 months ago
• archiki / GrIPS
  Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"
  ☆53Updated last year
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆34Updated 9 months ago
• RAIVNLab / mnms
  m&ms: A Benchmark to Evaluate Tool-Use for multi-step multi-modal tasks
  ☆37Updated 6 months ago