FSoft-AI4Code/CodeMMLU external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

FSoft-AI4Code/CodeMMLU

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/FSoft-AI4Code/CodeMMLU)

Close

FSoft-AI4Code / CodeMMLUView on GitHubMore

• External links
• Readme badge

[ICLR 2025] 🚀 CodeMMLU Evaluator: A framework for evaluating LM models on CodeMMLU MCQs benchmark.

☆29Apr 21, 2025Updated 10 months ago

Alternatives and similar repositories for CodeMMLU

Users that are interested in CodeMMLU are comparing it to the libraries listed below

• Fsoft-AIC / LibMoE

  View on GitHub
  LibMoE: A LIBRARY FOR COMPREHENSIVE BENCHMARKING MIXTURE OF EXPERTS IN LARGE LANGUAGE MODELS
  ☆46Jan 10, 2026Updated last month
• dsindex / tensorflow_examples

  View on GitHub
  reference code for tensorflow
  ☆13Jul 31, 2019Updated 6 years ago
• xiye17 / SketchRegex

  View on GitHub
  Sketch Driven Regular Expression Generation.
  ☆17Apr 26, 2023Updated 2 years ago
• aizip / Rag-Eval-flow

  View on GitHub
  A simple, easy-to-customize pipeline for local RAG evaluation. Starter prompts and metric definitions included.
  ☆25Jan 14, 2026Updated last month
• mobiusml / faster-whisper

  View on GitHub
  Faster Whisper ASR transcription with CTranslate2
  ☆24Oct 25, 2024Updated last year
• smallporridge / AssistRAG

  View on GitHub
  ☆22Jan 3, 2025Updated last year
• antonio-mastropaolo / T5-learning-ICSE_2021

  View on GitHub
  ☆24Jan 19, 2022Updated 4 years ago
• nguyenhoan / CPatMiner

  View on GitHub
  ☆23Sep 18, 2023Updated 2 years ago
• firstbatchxyz / function-calling-eval

  View on GitHub
  The DPAB-α Benchmark
  ☆32Jan 15, 2025Updated last year
• Mercury7353 / PyBench

  View on GitHub
  LLM Benchmark for Code
  ☆32Aug 6, 2024Updated last year
• kevinwu23 / StanfordFineTuneBench

  View on GitHub
  ☆31Nov 14, 2024Updated last year
• Alice1998 / URS

  View on GitHub
  URS Benchmark: Evaluating LLMs on User Reported Scenarios
  ☆30May 30, 2025Updated 9 months ago
• ThinkEx-OSS / thinkex

  View on GitHub
  Rethinking the User Interface of AI
  ☆32Updated this week
• IlyasMoutawwakil / py-txi

  View on GitHub
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆32Sep 19, 2025Updated 5 months ago
• amazon-science / llm-code-preference

  View on GitHub
  Training and Benchmarking LLMs for Code Preference.
  ☆38Nov 15, 2024Updated last year
• yagol2020 / SimADFuzz

  View on GitHub
  SimADFuzz: Simulation-Feedback Fuzz Testing for Autonomous Driving Systems
  ☆10Apr 11, 2025Updated 10 months ago
• swimmio / python_best_practices

  View on GitHub
  ☆10Aug 7, 2024Updated last year
• dylanashley / story-distiller

  View on GitHub
  ☆13Nov 5, 2024Updated last year
• justinphan3110 / CoTexT

  View on GitHub
  Code implementation for CoTexT: Multi-task Learning with Code-Text Transformer
  ☆36Sep 14, 2021Updated 4 years ago
• spyx / SysmonGrahp

  View on GitHub
  ☆16May 13, 2021Updated 4 years ago
• lukso-network / tools-dapp-boilerplate

  View on GitHub
  LUKSO dApps template in Next.js
  ☆11Jan 7, 2025Updated last year
• shengqiangzhang / transformer-pointer-generator-for-english-dataset

  View on GitHub
  An Abstractive Summarization(for Datasets in English format) Implementation with Transformer and Pointer-generator
  ☆12Dec 31, 2020Updated 5 years ago
• iGentAI / ferrous

  View on GitHub
  A Redis-compatible in-memory database server written in Rust with MLua-based Lua 5.1 scripting
  ☆17Nov 28, 2025Updated 3 months ago
• buaabyl / pedump

  View on GitHub
  An simplest PE parser, which list all import and export entries
  ☆12Oct 11, 2018Updated 7 years ago
• buildbot / buildbot-media

  View on GitHub
  Media around Buildbot - images, slides, papers, etc.
  ☆13Oct 6, 2019Updated 6 years ago
• sublimotion / rag-pinecone-ray

  View on GitHub
  rag-pinecone-ray
  ☆11Aug 14, 2023Updated 2 years ago
• icse20 / RT-CI

  View on GitHub
  ☆11Jul 20, 2021Updated 4 years ago
• futurekarol / jitogpt

  View on GitHub
  ☆13Jan 23, 2023Updated 3 years ago
• chziakas / backbone-learn

  View on GitHub
  A Library for Scaling Mixed-Integer Optimization-Based Machine Learning.
  ☆12Jun 24, 2024Updated last year
• stringdatabase / sdb64

  View on GitHub
  Open Source Multivalue String Database
  ☆13Feb 16, 2026Updated last week
• Zuhaitz-dev / TOMAT-OS

  View on GitHub
  Attempt of Operating System (C++)
  ☆21Oct 6, 2025Updated 4 months ago
• mtianyan / Mtianyan-Play-with-Machine-Learning-Algorithms

  View on GitHub
  Python3入门机器学习 经典算法与应用 学习
  ☆11Nov 9, 2018Updated 7 years ago
• btrettel / specialized-bibs

  View on GitHub
  ☆19Jan 15, 2026Updated last month
• NJU-iSE / FUEL

  View on GitHub
  This repo is the artifact of FUEL
  ☆13Dec 2, 2025Updated 2 months ago
• saikat107 / NatGen

  View on GitHub
  ☆41Jan 13, 2023Updated 3 years ago
• collinear-ai / spider

  View on GitHub
  Streamline on-policy/off-policy distillation workflows in a few lines of code
  ☆95Updated this week
• qdrant / demo-cloud-faq

  View on GitHub
  Demo of fine-tuning QA models for answering FAQ of cloud providers documentation
  ☆11Mar 7, 2023Updated 2 years ago
• icewall / AutoDiffAgent

  View on GitHub
  Agent installed on node to launch IDA,Bindiff,... and send results to the server ( AutoDiffWeb )
  ☆10Mar 25, 2016Updated 9 years ago
• Deveraux-Parker / Parakeet_Multitalk

  View on GitHub
  A realtime speech to text diarization system to gather and interleave speech from multiple speaker audio.
  ☆25Jan 29, 2026Updated last month