EleutherAI / dpsLinks
Data processing system for polyglot
☆91Updated last year
Alternatives and similar repositories for dps
Users that are interested in dps are comparing it to the libraries listed below
Sorting:
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Models☆25Updated 10 months ago
- Official repository for KoMT-Bench built by LG AI Research☆63Updated 10 months ago
- 🤗 최소한의 세팅으로 LM을 학습하기 위한 샘플코드☆58Updated 2 years ago
- 한국어 LLM 리더보드 및 모델 성능/안전성 관리☆22Updated last year
- bpe based korean t5 model for text-to-text unified framework☆63Updated last year
- [Google Meet] MLLM Arxiv Casual Talk☆52Updated 2 years ago
- 한국어 언어 모델 학습을 위한 프로젝트(Flax, Pytorch with Huggingface Accelerate)☆32Updated last year
- ☆32Updated last year
- CareCall for Seniors: Role Specified Open-Domain Dialogue dataset generated by leveraging LLMs (NAACL 2022).☆60Updated 3 years ago
- Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasets☆129Updated 2 years ago
- Performs benchmarking on two Korean datasets with minimal time and effort.☆40Updated last month
- 한국어 T5 모델☆54Updated 3 years ago
- Korean Math Word Problems☆59Updated 3 years ago
- [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation☆27Updated 2 years ago
- Finetuning Pipeline☆90Updated 3 years ago
- Code and data for "KoDialogBench: Evaluating Conversational Understanding of Language Models with Korean Dialogue Benchmark" (LREC-COLING…☆16Updated 2 months ago
- A utility for storing and reading files for Korean LM training 💾☆36Updated last year
- Adversarial Test Dataset for Korean Multi-turn Response Selection☆35Updated 3 years ago
- ☆35Updated last year
- Reward Model을 이용하여 언어모델의 답변을 평가하기☆29Updated last year
- evolve llm training instruction, from english instruction to any language.☆118Updated last year
- ☆28Updated 2 years ago
- StrategyQA 데이터 세트 번역☆22Updated last year
- ☆20Updated last year
- Train GEMMA on TPU/GPU! (Codebase for training Gemma-Ko Series)☆47Updated last year
- KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)☆25Updated 3 years ago
- CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Korean☆45Updated 6 months ago
- Dataset of Korean Threatening Conversations☆74Updated 2 years ago
- Character-level Korean ELECTRA Model (음절 단위 한국어 ELECTRA)☆54Updated 2 years ago
- kogpt를 oslo로 파인튜닝하는 예제.☆23Updated 2 years ago