UpstageAI / evalverse
The Universe of Evaluation. All about the evaluation for LLMs.
☆224Updated 9 months ago
Alternatives and similar repositories for evalverse:
Users that are interested in evalverse are comparing it to the libraries listed below
- 1-Click is all you need.☆61Updated 11 months ago
- The Universe of Data. All about data, data science, and data engineering☆548Updated 9 months ago
- evolve llm training instruction, from english instruction to any language.☆115Updated last year
- 자체 구축한 한국어 평가 데이터셋을 이용한 한국어 모델 평가☆31Updated 10 months ago
- AutoRAG example about benchmarking Korean embeddings.☆37Updated 6 months ago
- 한국어 벤치마크 평가 코드 통합본(?)☆17Updated 5 months ago
- ☆67Updated last year
- Forked repo from https://github.com/EleutherAI/lm-evaluation-harness/commit/1f66adc☆76Updated last year
- 구글에서 발표한 Chain-of-Thought Reasoning without Prompting을 코드로 구현한 레포입니다.☆65Updated 6 months ago
- Efficient fine-tuning for ko-llm models☆183Updated last year
- LLM 모델의 외국어 토큰 생성을 막는 코드 구현☆69Updated 3 weeks ago
- [KO-Platy🥮] Korean-Open-platypus를 활용하여 llama-2-ko를 fine-tuning한 KO-platypus model☆75Updated last year
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Models☆25Updated 8 months ago
- The most modern LLM evaluation toolkit☆55Updated 2 weeks ago
- Official repository for KoMT-Bench built by LG AI Research☆62Updated 8 months ago
- ☆86Updated 4 months ago
- Data processing system for polyglot☆91Updated last year
- Train GEMMA on TPU/GPU! (Codebase for training Gemma-Ko Series)☆47Updated last year
- The list of NLP paper and news I've checked. There might be short description of them (abstract) in Korean.☆24Updated this week
- Extension of Langchain for RAG. Easy benchmarking, multiple retrievals, reranker, time-aware RAG, and so on...☆280Updated last year
- ☆19Updated 9 months ago
- Sakura-SOLAR-DPO: Merge, SFT, and DPO☆117Updated last year
- Korean Sentence Embedding Model Performance Benchmark for RAG☆48Updated 2 months ago
- Benchmarking library for RAG☆193Updated last week
- Make running benchmark simple yet maintainable, again. Now only supports Korean-based cross-encoder.☆15Updated this week
- This repository aims to develop CoT Steering based on CoT without Prompting. It focuses on enhancing the model’s latent reasoning capabil…☆94Updated last month
- 한국어 언어모델 다분야 사고력 벤치마크☆189Updated 6 months ago
- Performs benchmarking on two Korean datasets with minimal time and effort.☆38Updated last week
- BERT score for text generation☆11Updated 3 months ago
- IA3방식으로 KoAlpaca를 fine tuning한 한국어 LLM모델☆68Updated last year