Alternatives and similar repositories for pseudo-code-instructions

Users that are interested in pseudo-code-instructions are comparing it to the libraries listed below

• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆49Updated 2 years ago
• niansong1996 / lever
  Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)
  ☆90Updated 2 years ago
• asaparov / prontoqa
  Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.
  ☆154Updated 5 months ago
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆116Updated 7 months ago
• reasoning-machines / CoCoGen
  Language Models of Code are Few-Shot Commonsense Learners (EMNLP 2022)
  ☆86Updated 2 years ago
• nyu-mll / ILF-for-code-generation
  ☆80Updated 10 months ago
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆85Updated last year
• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆64Updated last year
• eladsegal / strategyqa
  The official code of TACL 2021, "Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies".
  ☆83Updated 3 years ago
• kernelmachine / silo-lm
  SILO Language Models code repository
  ☆83Updated last year
• shunzh / Code-AI-Tree-Search
  ☆119Updated last year
• allenai / Lila
  A unified benchmark for math reasoning
  ☆89Updated 3 years ago
• wenhuchen / TheoremQA
  The dataset and code for paper: TheoremQA: A Theorem-driven Question Answering dataset
  ☆160Updated last year
• neulab / data-agora
  [ACL 2025 Main] Official Repository for "Evaluating Language Models as Synthetic Data Generators"
  ☆40Updated last year
• jaehunjung1 / Maieutic-Prompting
  ☆50Updated 2 years ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆86Updated last year
• skywalker023 / fantom
  👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions"
  ☆59Updated last year
• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆61Updated last year
• mukhal / GRACE
  [EMNLP '23] Discriminator-Guided Chain-of-Thought Reasoning
  ☆50Updated last year
• SeungoneKim / CoTEVer
  [EACL 2023] CoTEVer: Chain of Thought Prompting Annotation Toolkit for Explanation Verification
  ☆41Updated 2 years ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• archiki / ReCEval
  Supporting code for ReCEval paper
  ☆31Updated last year
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆78Updated last year
• rmshin / llm-mcts
  ☆41Updated last year
• Nanami18 / Snowballed_Hallucination
  ☆43Updated last year
• google-research / arcade-nl2code
  ☆54Updated 2 years ago
• sambanova / toolbench
  ToolBench, an evaluation suite for LLM tool manipulation capabilities.
  ☆172Updated last year
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆78Updated 2 years ago
• princeton-nlp / Collie
  [ICLR 2024] COLLIE: Systematic Construction of Constrained Text Generation Tasks
  ☆59Updated 2 years ago
• joeljang / ELM
  [ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning
  ☆98Updated 2 years ago