UpstageAI / evalverse
The Universe of Evaluation. All about the evaluation for LLMs.
☆222Updated 7 months ago
Alternatives and similar repositories for evalverse:
Users that are interested in evalverse are comparing it to the libraries listed below
- evolve llm training instruction, from english instruction to any language.☆115Updated last year
- 1-Click is all you need.☆59Updated 9 months ago
- AutoRAG example about benchmarking Korean embeddings.☆32Updated 4 months ago
- 구글에서 발표한 Chain-of-Thought Reasoning without Prompting을 코드로 구현한 레포입니다.☆62Updated 4 months ago
- The Universe of Data. All about data, data science, and data engineering☆540Updated 7 months ago
- ☆66Updated 11 months ago
- Forked repo from https://github.com/EleutherAI/lm-evaluation-harness/commit/1f66adc☆76Updated 11 months ago
- [KO-Platy🥮] Korean-Open-platypus를 활용하여 llama-2-ko를 fine-tuning한 KO-platypus model☆77Updated last year
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Models☆25Updated 5 months ago
- Korean Sentence Embedding Model Performance Benchmark for RAG☆47Updated 3 weeks ago
- 자체 구축한 한국어 평가 데이터셋을 이용한 한국어 모델 평가☆31Updated 8 months ago
- Official repository for KoMT-Bench built by LG AI Research☆55Updated 6 months ago
- The list of NLP paper and news I've checked. There might be short description of them (abstract) in Korean.☆21Updated this week
- Train GEMMA on TPU/GPU! (Codebase for training Gemma-Ko Series)☆46Updated 11 months ago
- ☆19Updated 6 months ago
- Data processing system for polyglot☆92Updated last year
- IA3방식으로 KoAlpaca를 fine tuning한 한국어 LLM모델☆68Updated last year
- Performs benchmarking on two Korean datasets with minimal time and effort.☆31Updated 2 weeks ago
- Sakura-SOLAR-DPO: Merge, SFT, and DPO☆116Updated last year
- 한글 텍스트 임베딩 모델 리더보드☆63Updated 4 months ago
- KURE: 고려대학교에서 개발한, 한국어 검색에 특화된 임베딩 모델☆137Updated last month
- [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…☆297Updated last year
- ☆73Updated 2 months ago
- Efficient fine-tuning for ko-llm models☆183Updated 11 months ago
- Benchmarking library for RAG☆167Updated this week
- This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.☆295Updated this week
- Extension of Langchain for RAG. Easy benchmarking, multiple retrievals, reranker, time-aware RAG, and so on...☆279Updated last year
- Paper list and short/long summaries I've read for my research or interests☆18Updated 8 months ago
- 한국어 벤치마크 평가 코드 통합본(?)☆13Updated 3 months ago
- This repo Implements "Dense Passage Retrieval for Open-Domain Question Answering" using Korean Dataset☆74Updated 2 years ago