codefuse-ai / codefuse-evaluation

Related projects: ⓘ

• CoderEval / CoderEval
  A collection of practical code generation tasks and tests in open source projects. Complementary to HumanEval by OpenAI.
  ☆107Updated 9 months ago
• yiyepiaoling0715 / codellm-data-preprocess-pipeline
  代码大模型 预训练&微调&DPO 数据处理 业界处理pipeline sota
  ☆25Updated last month
• CodeArtsSnap / CoderEval
  A collection of practical code generation tasks and tests from open source projects. Complementary to HumanEval by OpenAI.
  ☆21Updated last year
• sufengniu / RefGPT
  ☆156Updated last year
• hiyouga / LLaMA-Factory-Doc
  LLaMA Factory Document
  ☆61Updated 3 weeks ago
• seketeam / EvoCodeBench
  An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories
  ☆38Updated last month
• allanj / repo-level-codegen-papers
  Repo-Level Code generation papers
  ☆66Updated 3 months ago
• OpenBMB / UltraEval
  [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.
  ☆209Updated this week
• amazon-science / cceval
  CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)
  ☆114Updated last month
• THUDM / NaturalCodeBench
  ☆52Updated 2 months ago
• CLUEbenchmark / SuperCLUE-Agent
  SuperCLUE-Agent: 基于中文原生任务的Agent智能体核心能力测评基准
  ☆78Updated 10 months ago
• IAAR-Shanghai / CRUD_RAG
  CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models
  ☆217Updated last month
• aixcoder-plugin / nl2code-dataset
  Aix-bench, the Java benchmark for code synthesis problem.
  ☆51Updated 2 years ago
• RepoUnderstander / RepoUnderstander
  Official implementation of paper How to Understand Whole Repository? New SOTA on SWE-bench Lite (21.3%)
  ☆55Updated 3 months ago
• yanqiangmiffy / how-to-train-tokenizer
  怎么训练一个LLM分词器
  ☆123Updated last year
• X-PLUG / Multi-LLM-Agent
  ☆180Updated 4 months ago
• THUDM / AlignBench
  大模型多维度中文对齐评测基准 (ACL 2024)
  ☆293Updated last month
• code-rag-bench / code-rag-bench
  CodeRAG-Bench: Can Retrieval Augment Code Generation?
  ☆54Updated 2 months ago
• chanchimin / RQ-RAG
  Codes for our paper "RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generation"
  ☆95Updated last month
• tangqiaoyu / ToolAlpaca
  ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Cases
  ☆281Updated 2 months ago
• ZJU-M3 / TableGPT-techreport
  The report of a fine-tuned GPT model unifying tables, natural language, and commands.
  ☆97Updated 9 months ago
• luban-agi / Awesome-Tool-Learning
  A curated list of papers and applications on tool learning.
  ☆107Updated 8 months ago
• thu-coai / BPO
  ☆286Updated 2 months ago
• thu-coai / CritiqueLLM
  ☆124Updated 2 months ago
• zxx000728 / CodeGPT
  CodeGPT: A Code-Related Dialogue Dataset Generated by GPT and for GPT
  ☆106Updated last year
• codefuse-ai / codefuse
  Index of the CodeFuse Repositories
  ☆132Updated 2 weeks ago
• CASIA-LM / MoDS
  ☆109Updated 5 months ago
• the-seeds / imitater
  Imitate OpenAI with Local Models
  ☆83Updated 3 weeks ago
• MikeGu721 / XiezhiBenchmark
  ☆89Updated 9 months ago
• codefuse-ai / MFTCoder
  High Accuracy and efficiency multi-task fine-tuning framework for Code LLMs. This work has been accepted by KDD 2024.
  ☆618Updated 3 months ago