Alternatives and similar repositories for CMMLU:

Users that are interested in CMMLU are comparing it to the libraries listed below

• hkust-nlp / ceval
  Official github repo for C-Eval, a Chinese evaluation suite for foundation models [NeurIPS 2023]
  ☆1,665Updated last year
• OpenLMLab / GAOKAO-Bench
  GAOKAO-Bench is an evaluation framework that utilizes GAOKAO questions as a dataset to evaluate large language models.
  ☆580Updated last week
• HIT-SCIR / Chinese-Mixtral-8x7B
  中文Mixtral-8x7B（Chinese-Mixtral-8x7B）
  ☆645Updated 5 months ago
• beyondguo / LLM-Tuning
  Tuning LLMs with no tears💦; Sample Design Engineering (SDE) for more efficient downstream-tuning.
  ☆982Updated 8 months ago
• THUDM / AlignBench
  大模型多维度中文对齐评测基准 (ACL 2024)
  ☆353Updated 5 months ago
• wangyuxinwhy / uniem
  unified embedding model
  ☆847Updated last year
• hikariming / chat-dataset-baseline
  人工精调的中文对话数据集和一段chatglm的微调代码
  ☆1,167Updated 8 months ago
• shuxueslpi / chatGLM-6B-QLoRA
  使用peft库，对chatGLM-6B/chatGLM2-6B实现4bit的QLoRA高效微调，并做lora model和base model的merge及4bit的量化（quantize）。
  ☆356Updated last year
• yangjianxin1 / Firefly-LLaMA2-Chinese
  Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型
  ☆403Updated last year
• chaoswork / sft_datasets
  开源SFT数据集整理,随时补充
  ☆474Updated last year
• X-PLUG / CValues
  面向中文大模型价值观的评估与对齐研究
  ☆489Updated last year
• jianzhnie / LLamaTuner
  Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
  ☆585Updated this week
• modelscope / evalscope
  A streamlined and customizable framework for efficient large model evaluation and performance benchmarking
  ☆357Updated this week
• yanqiangmiffy / InstructGLM
  ChatGLM-6B 指令学习|指令数据|Instruct
  ☆653Updated last year
• flageval-baai / FlagEval
  FlagEval is an evaluation toolkit for AI large foundation models.
  ☆315Updated 6 months ago
• charent / Phi2-mini-Chinese
  Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.
  ☆516Updated 6 months ago
• FlagAI-Open / Aquila2
  The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.
  ☆440Updated 3 months ago
• liangwq / Chatglm_lora_multi-gpu
  chatglm多gpu用deepspeed和
  ☆404Updated 6 months ago
• HIT-SCIR / huozi
  活字通用大模型
  ☆363Updated 4 months ago
• ECNU-ICALK / EduChat
  An open-source educational chat model from ICALK, East China Normal University. 开源中英教育对话大模型。(通用基座模型，GPU部署，数据清理) 致敬: LLaMA, MOSS, BELLE, Z…
  ☆739Updated 3 months ago
• SpongebBob / Finetune-ChatGLM2-6B
  ChatGLM2-6B 全参数微调，支持多轮对话的高效微调。
  ☆397Updated last year
• thu-coai / Safety-Prompts
  Chinese safety prompts for evaluating and improving the safety of LLMs. 中文安全prompts，用于评估和提升大模型的安全性。
  ☆898Updated 10 months ago
• SpursGoZmy / Tabular-LLM
  本项目旨在收集开源的表格智能任务数据集（比如表格问答、表格-文本生成等），将原始数据整理为指令微调格式的数据并微调LLM，进而增强LLM对于表格数据的理解，最终构建出专门面向表格智能任务的大型语言模型。
  ☆518Updated 8 months ago
• Neutralzz / BiLLa
  BiLLa: A Bilingual LLaMA with Enhanced Reasoning Ability
  ☆421Updated last year
• CLUEbenchmark / pCLUE
  pCLUE: 1000000+多任务提示学习数据集
  ☆475Updated 2 years ago
• ymcui / Chinese-Mixtral
  中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）
  ☆591Updated 8 months ago
• xverse-ai / XVERSE-13B
  XVERSE-13B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆648Updated 9 months ago
• twang2218 / vocab-coverage
  语言模型中文认知能力分析
  ☆236Updated last year
• Tencent / TencentPretrain
  Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
  ☆1,054Updated 5 months ago