code-rag-bench / code-rag-bench

Related projects: ⓘ

• amazon-science / Repoformer
  Repoformer: Selective Retrieval for Repository-Level Code Completion (ICML 2024)
  ☆33Updated 2 months ago
• xlang-ai / arks
  ☆48Updated 3 months ago
• CodeEditorBench / CodeEditorBench
  ☆39Updated 3 months ago
• SparksofAGI / MHPP
  ☆25Updated last week
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆100Updated 3 months ago
• wasiahmad / Awesome-LLM-Synthetic-Data
  A reading list on LLM based Synthetic Data Generation 🔥
  ☆105Updated last month
• THUDM / NaturalCodeBench
  ☆52Updated 2 months ago
• open-compass / DevBench
  A Comprehensive Benchmark for Software Development.
  ☆84Updated 3 months ago
• Hannibal046 / xRAG
  Source code for xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token
  ☆80Updated 2 months ago
• amazon-science / cceval
  CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)
  ☆114Updated last month
• thunlp / MatPlotAgent
  ☆45Updated 2 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆45Updated 6 months ago
• KwanWaiChung / MT-Eval
  Code and data for "MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models"
  ☆28Updated 6 months ago
• zjunlp / AutoAct
  [ACL 2024] AUTOACT: Automatic Agent Learning from Scratch for QA via Self-Planning
  ☆162Updated 5 months ago
• WENGSYX / Self-Verification
  We have released the code and demo program required for LLM with self-verification
  ☆45Updated 11 months ago
• qishenghu / CodeInstruct
  InstructCoder (former name:Codelnstruct) enables LLMs to edit code
  ☆47Updated 6 months ago
• oceaneLIU / GraphCoder
  ☆17Updated 3 months ago
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆82Updated 2 months ago
• seketeam / EvoCodeBench
  An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories
  ☆38Updated last month
• Junjie-Ye / ToolEyes
  ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆63Updated 5 months ago
• OpenBMB / RAGEval
  ☆32Updated 2 weeks ago
• SuperBruceJia / Awesome-LLM-Self-Consistency
  Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models
  ☆54Updated last month
• oneal2000 / DRAGIN
  Source code of DRAGIN, ACL 2024 main conference Long Paper
  ☆60Updated this week
• THUNLP-MT / StableToolBench
  A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.
  ☆101Updated this week
• JoeYing1019 / UltraTool
  [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios
  ☆36Updated 5 months ago
• zorazrw / awesome-tool-llm
  ☆170Updated last month
• allanj / repo-level-codegen-papers
  Repo-Level Code generation papers
  ☆66Updated 3 months ago
• thunlp / DebugBench
  The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
  ☆52Updated 2 months ago
• thu-coai / AutoDetect
  Official github repo for AutoDetect, an automated weakness detection framework for LLMs.
  ☆36Updated 2 months ago
• FloatAI / humaneval-xl
  [LREC-COLING'24] HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization
  ☆25Updated this week