UpstageAI / evalverseLinks
The Universe of Evaluation. All about the evaluation for LLMs.
☆224Updated last year
Alternatives and similar repositories for evalverse
Users that are interested in evalverse are comparing it to the libraries listed below
Sorting:
- 1-Click is all you need.☆62Updated last year
- ☆20Updated 11 months ago
- 구글에서 발표한 Chain-of-Thought Reasoning without Prompting을 코드로 구현한 레포입니다.☆66Updated 9 months ago
- evolve llm training instruction, from english instruction to any language.☆118Updated last year
- Efficient fine-tuning for ko-llm models☆182Updated last year
- 자체 구축한 한국어 평가 데이터셋을 이용한 한국어 모델 평가☆31Updated last year
- Official repository for KoMT-Bench built by LG AI Research☆64Updated 11 months ago
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Models☆25Updated 10 months ago
- Forked repo from https://github.com/EleutherAI/lm-evaluation-harness/commit/1f66adc☆79Updated last year
- LLM 모델의 외국어 토큰 생성을 막는 코드 구현☆75Updated last week
- Make running benchmark simple yet maintainable, again. Now only supports Korean-based cross-encoder.☆19Updated 3 weeks ago
- The Universe of Data. All about data, data science, and data engineering☆551Updated 11 months ago
- Extension of Langchain for RAG. Easy benchmarking, multiple retrievals, reranker, time-aware RAG, and so on...☆281Updated last year
- [KO-Platy🥮] Korean-Open-platypus를 활용하여 llama-2-ko를 fine-tuning한 KO-platypus model☆75Updated last year
- ☆97Updated 7 months ago
- ☆68Updated last year
- The most modern LLM evaluation toolkit☆66Updated this week
- Performs benchmarking on two Korean datasets with minimal time and effort.☆40Updated last month
- AutoRAG example about benchmarking Korean embeddings.☆38Updated 9 months ago
- BERT score for text generation☆12Updated 6 months ago
- Data processing system for polyglot☆91Updated last year
- Benchmarking library for RAG☆213Updated last month
- [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…☆300Updated last year
- Train GEMMA on TPU/GPU! (Codebase for training Gemma-Ko Series)☆48Updated last year
- Here's how to use Lama3 for beginners and what services are being used.☆77Updated last year
- Sakura-SOLAR-DPO: Merge, SFT, and DPO☆116Updated last year
- OpenOrca-KO dataset을 활용하여 llama2를 fine-tuning한 Korean-OpenOrca☆19Updated last year
- The list of NLP paper and news I've checked. There might be short description of them (abstract) in Korean.☆29Updated this week
- 한국어 벤치마크 평가 코드 통합본(?)☆17Updated 8 months ago
- huggingface에 있는 한국어 데이터 세트☆29Updated 9 months ago