Alternatives and similar repositories for LLM-evaluation-datasets

Users that are interested in LLM-evaluation-datasets are comparing it to the libraries listed below

• IAAR-Shanghai / CTGSurvey
  Controllable Text Generation for Large Language Models: A Survey
  ☆179Updated 10 months ago
• pillowsofwind / Knowledge-Conflicts-Survey
  [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"
  ☆126Updated 9 months ago
• xsc1234 / INFO-RAG
  Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generation
  ☆51Updated 6 months ago
• AI45Lab / Flames
  Flames is a highly adversarial benchmark in Chinese for LLM's harmlessness evaluation developed by Shanghai AI Lab and Fudan NLP Group.
  ☆51Updated last year
• LightChen233 / reasoning-boundary
  ☆62Updated last week
• NIL-zhuang / EfficientRAG-official
  Code Repo for EfficientRAG: Efficient Retriever for Multi-Hop Question Answering
  ☆49Updated 3 months ago
• liunian-Jay / Awesome-RAG
  An up-to-date curated list of Retrieval-Augmented Generation (RAG) for LLMs.
  ☆90Updated last week
• IAAR-Shanghai / UHGEval
  [ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.
  ☆167Updated 2 weeks ago
• zhuohaoyu / KIEval
  [ACL'24] A Knowledge-grounded Interactive Evaluation Framework for Large Language Models
  ☆36Updated 11 months ago
• dongguanting / DPA-RAG
  The code and data of DPA-RAG, accepted by WWW 2025 main conference.
  ☆61Updated 5 months ago
• AmourWaltz / Reliable-LLM
  ☆133Updated 9 months ago
• THU-KEG / Crab
  Constraint Back-translation Improves Complex Instruction Following of Large Language Models
  ☆13Updated last month
• thu-coai / AutoDetect
  Official github repo for AutoDetect, an automated weakness detection framework for LLMs.
  ☆42Updated last year
• shizhl / Multi-Agent-Papers
  The awesome agents in the era of large language models
  ☆65Updated last year
• PolarisRisingWar / Math_Word_Problem_Collection
  A collection for math word problem (MWP) works, including datasets, algorithms and so on.
  ☆43Updated last year
• RUCKBReasoning / CoT-based-Synthesizer
  Official code implementation for the ACL 2025 paper: 'CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis'
  ☆27Updated last month
• junzhuang-code / LLMSurveySummary
  A collection of survey papers and resources related to Large Language Models (LLMs).
  ☆40Updated last year
• pldlgb / nuggets
  ☆82Updated last year
• dongguanting / FollowRAG
  The demo, code and data of FollowRAG
  ☆73Updated 2 months ago
• NEUIR / COAST
  Official repository for the paper "COAST: Enhancing the Code Debugging Ability of LLMs through Communicative Agent Based Data Synthesis".
  ☆13Updated 4 months ago
• Yiwei98 / TDG
  ☆28Updated last year
• ShiyuNee / Awesome-LMs-Perception-of-Their-Knowledge-Boundaries-Papers
  This is a repo consisting of papers about LLMs' perception of their knowledge boundaries
  ☆13Updated last month
• Hongcheng-Gao / Awesome-Long2short-on-LRMs
  Awesome-Long2short-on-LRMs is a collection of state-of-the-art, novel, exciting long2short methods on large reasoning models. It contains…
  ☆228Updated 3 weeks ago
• wanghanbinpanda / Large-Language-Models-for-Code
  Large Language Models(LLMs) of Code
  ☆18Updated 2 years ago
• wuyike2000 / CoTKR
  ☆31Updated 5 months ago
• plageon / SlimPlm
  Small Models, Big Insights: Leveraging Slim Proxy Models To Decide When and What to Retrieve for LLMs (ACL 2024)
  ☆67Updated last month
• MikeGu721 / XiezhiBenchmark
  ☆97Updated last year
• thunlp / Adaptive-Note
  ☆57Updated 8 months ago
• CASIA-LM / MoDS
  ☆141Updated last year
• nuochenpku / Awesome-Role-Play-Papers
  Awesome papers for role-playing with language models
  ☆193Updated 7 months ago