Alternatives and similar repositories for Awesome-LLM-Eval:

Users that are interested in Awesome-LLM-Eval are comparing it to the libraries listed below

• THUDM / AlignBench
  大模型多维度中文对齐评测基准 (ACL 2024)
  ☆355Updated 5 months ago
• tianyi-lab / Cherry_LLM
  [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…
  ☆333Updated 4 months ago
• THUDM / LongBench
  LongBench v2 and LongBench (ACL 2024)
  ☆762Updated 2 weeks ago
• NovaSearch-Team / RAG-Retrieval
  Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.
  ☆668Updated this week
• chen700564 / RGB
  ☆295Updated 8 months ago
• pengr / LLM-Synthetic-Data
  Real-time updated, fine-grained reading list on LLM-synthetic-data.🔥
  ☆201Updated this week
• flageval-baai / FlagEval
  FlagEval is an evaluation toolkit for AI large foundation models.
  ☆316Updated 6 months ago
• OpenBMB / UltraEval
  [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.
  ☆231Updated 2 months ago
• chaoswork / sft_datasets
  开源SFT数据集整理,随时补充
  ☆475Updated last year
• ZigeW / data_management_LLM
  Collection of training data management explorations for large language models
  ☆306Updated 5 months ago
• HqWu-HITCS / Awesome-LLM-Survey
  An Awesome Collection for LLM Survey
  ☆323Updated 4 months ago
• IAAR-Shanghai / CRUD_RAG
  CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models
  ☆265Updated 2 months ago
• GPT-Fathom / GPT-Fathom
  GPT-Fathom is an open-source and reproducible LLM evaluation suite, benchmarking 10+ leading open-source and closed-source LLMs as well a…
  ☆349Updated 9 months ago
• modelscope / evalscope
  A streamlined and customizable framework for efficient large model evaluation and performance benchmarking
  ☆378Updated this week
• Wang-Shuo / A-Guide-to-Retrieval-Augmented-LLM
  an intro to retrieval augmented large language model
  ☆272Updated last year
• ArtificialZeng / Baichuan2-Explained
  Baichuan2代码的逐行解析版本，适合小白
  ☆211Updated last year
• X-PLUG / CValues
  面向中文大模型价值观的评估与对齐研究
  ☆490Updated last year
• thunlp / ToolLearningPapers
  ☆889Updated 6 months ago
• km1994 / llms_paper
  该仓库主要记录 LLMs 算法工程师相关的顶会论文研读笔记（多模态、PEFT、小样本QA问答、RAG、LMMs可解释性、Agents、CoT）
  ☆285Updated 10 months ago
• Glanvery / LLM-Travel
  欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。
  ☆287Updated 6 months ago
• yongzhuo / LLM-SFT
  中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微…
  ☆183Updated 8 months ago
• hkust-nlp / deita
  Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]
  ☆531Updated last month
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆410Updated 5 months ago
• WeOpenML / PandaLM
  ☆901Updated 8 months ago
• FlagOpen / FlagData
  ☆291Updated 7 months ago
• wgwang / awesome-LLM-benchmarks
  Awesome LLM Benchmarks to evaluate the LLMs across text, code, image, audio, video and more.
  ☆130Updated last year
• OpenLMLab / GAOKAO-Bench
  GAOKAO-Bench is an evaluation framework that utilizes GAOKAO questions as a dataset to evaluate large language models.
  ☆586Updated 3 weeks ago
• git-cloner / llama2-lora-fine-tuning
  llama2 finetuning with deepspeed and lora
  ☆172Updated last year
• DAMO-NLP-SG / LLM-Zoo
  LLM Zoo collects information of various open- and close-sourced LLMs
  ☆273Updated last year
• yangjianxin1 / Firefly-LLaMA2-Chinese
  Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型
  ☆403Updated last year