microsoft / prose-benchmarks

Related projects ⓘ

Alternatives and complementary repositories for prose-benchmarks

• THUDM / NaturalCodeBench
  NaturalCodeBench (Findings of ACL 2024)
  ☆56Updated 3 weeks ago
• CodeEditorBench / CodeEditorBench
  ☆39Updated 5 months ago
• nyu-mll / ILF-for-code-generation
  ☆75Updated last year
• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆52Updated last month
• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆43Updated 10 months ago
• bigcode-project / astraios
  Astraios: Parameter-Efficient Instruction Tuning Code Language Models
  ☆57Updated 7 months ago
• ntunlp / xCodeEval
  xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval
  ☆74Updated last month
• rmshin / llm-mcts
  ☆23Updated 4 months ago
• Ablustrund / APPS_Plus
  StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback
  ☆52Updated 2 months ago
• xlang-ai / arks
  ☆50Updated 4 months ago
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆61Updated last year
• martin-wey / CodeUltraFeedback
  CodeUltraFeedback: aligning large language models to coding preferences
  ☆65Updated 4 months ago
• SalesforceAIResearch / CodeChain
  Official code for the paper "CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules"
  ☆34Updated 11 months ago
• abhika-m / FAVA
  ☆56Updated 8 months ago
• reasoning-machines / CoCoGen
  Language Models of Code are Few-Shot Commonsense Learners (EMNLP 2022)
  ☆86Updated last year
• crux-eval / eval-arena
  ☆18Updated last week
• WENGSYX / LMTuner
  LMTuner: Make the LLM Better for Everyone
  ☆33Updated last year
• SparksofAGI / MHPP
  ☆25Updated this week
• yegcjs / mixinglaws
  ☆89Updated last month
• ntunlp / ExecEval
  A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.
  ☆41Updated 2 weeks ago
• xlang-ai / batch-prompting
  [EMNLP 2023 Industry Track] A simple prompting approach that enables the LLMs to run inference in batches.
  ☆68Updated 8 months ago
• bigcode-project / bigcode-encoder
  ☆29Updated last year
• allenai / sso
  Repository for Skill Set Optimization
  ☆12Updated 3 months ago
• liyucheng09 / Contamination_Detector
  Lightweight tool to identify Data Contamination in LLMs evaluation
  ☆40Updated 8 months ago
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆25Updated last year
• theblackcat102 / evol-dataset
  evol augment any dataset online
  ☆55Updated last year
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆99Updated last week
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆41Updated 8 months ago
• ekinakyurek / gpt3-arithmetic
  Scratchpad/Chain-of-Thought Prompts
  ☆12Updated 2 years ago
• shunzh / Code-AI-Tree-Search
  ☆105Updated 3 months ago