The Universe of Evaluation. All about the evaluation for LLMs.
☆232Jul 9, 2024Updated last year
Alternatives and similar repositories for evalverse
Users that are interested in evalverse are comparing it to the libraries listed below
Sorting:
- The Universe of Data. All about data, data science, and data engineering☆565Jul 18, 2024Updated last year
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Models☆25Aug 24, 2024Updated last year
- ☆20Jul 24, 2024Updated last year
- ☁️ 구름(KULLM): 고려대학교에서 개발한, 한국어에 특화된 LLM☆589May 1, 2024Updated last year
- Reward Model을 이용하여 언어모델의 답변을 평가하기☆29Feb 23, 2024Updated 2 years ago
- Difference-based Contrastive Learning for Korean Sentence Embeddings☆23Updated this week
- ☆34Feb 27, 2024Updated 2 years ago
- A Situational Conversation-Based English Education Platform☆21Jan 16, 2026Updated last month
- Benchmark in Korean Context☆138Sep 26, 2023Updated 2 years ago
- bpe based korean t5 model for text-to-text unified framework☆63Apr 17, 2024Updated last year
- Official repository for KoMT-Bench built by LG AI Research☆71Aug 8, 2024Updated last year
- Code for the paper "You Truly Understand What I Need : Intellectual and Friendly Dialogue Agents grounding Knowledge and Persona" which i…☆23Apr 6, 2023Updated 2 years ago
- 한국어 언어모델 다분야 사고력 벤치마크☆201Oct 17, 2024Updated last year
- The most modern LLM evaluation toolkit☆70Nov 9, 2025Updated 3 months ago
- Forked repo from https://github.com/EleutherAI/lm-evaluation-harness/commit/1f66adc☆82Feb 28, 2024Updated 2 years ago
- Official datasets and pytorch implementation repository of SQuARe and KoSBi (ACL 2023)☆248Jun 29, 2023Updated 2 years ago
- 언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.☆452Apr 13, 2025Updated 10 months ago
- 한국어 생성 모델의 상식 추론을 위한 KommonGen 데이터셋입니다.☆17Oct 5, 2021Updated 4 years ago
- ☆19Mar 4, 2024Updated last year
- Korean Sentence Embedding Repository☆210Dec 1, 2024Updated last year
- ☆12Dec 20, 2024Updated last year
- A lightweight adjustment tool for smoothing token probabilities in the Qwen models to encourage balanced multilingual generation.☆104Jul 9, 2025Updated 7 months ago
- ☆116Updated this week
- Liner LLM Meetup archive☆71Mar 27, 2024Updated last year
- KURE: 고려대학교에서 개발한, 한국어 검색에 특화된 임베딩 모델☆206Feb 20, 2026Updated last week
- The official evaluation suite and dynamic data release for MixEval.☆255Nov 10, 2024Updated last year
- Submodule of evalverse forked from [google-research/instruction_following_eval](https://github.com/google-research/google-research/tree/m…☆14May 4, 2024Updated last year
- [Google Meet] MLLM Arxiv Casual Talk☆52Mar 16, 2023Updated 2 years ago
- Sakura-SOLAR-DPO: Merge, SFT, and DPO☆116Dec 30, 2023Updated 2 years ago
- Evaluate your LLM's response with Prometheus and GPT4 💯☆1,046Apr 25, 2025Updated 10 months ago
- Source codes and dataset of Call for Customized Conversation: Customized Conversation Grounding Persona and Knowledge☆62Aug 4, 2023Updated 2 years ago
- Code and data for "KoDialogBench: Evaluating Conversational Understanding of Language Models with Korean Dialogue Benchmark" (LREC-COLING…☆17Apr 15, 2025Updated 10 months ago
- Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning + ?☆18Jan 31, 2025Updated last year
- ☆21Updated this week
- Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasets☆130Nov 12, 2022Updated 3 years ago
- Korean Commonsense Knowledge Graph☆15Dec 23, 2022Updated 3 years ago
- ☆61Sep 18, 2025Updated 5 months ago
- Chain-of-thought 방식을 활용하여 llama2를 fine-tuning☆10Nov 18, 2023Updated 2 years ago
- BERT score for text generation☆12Jan 15, 2025Updated last year