EleutherAI / dpsLinks
Data processing system for polyglot
☆93Updated 2 years ago
Alternatives and similar repositories for dps
Users that are interested in dps are comparing it to the libraries listed below
Sorting:
- Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasets☆130Updated 3 years ago
- bpe based korean t5 model for text-to-text unified framework☆63Updated last year
- [Google Meet] MLLM Arxiv Casual Talk☆52Updated 2 years ago
- Official repository for KoMT-Bench built by LG AI Research☆71Updated last year
- Korean Math Word Problems☆59Updated 4 years ago
- ☆33Updated 2 years ago
- 🤗 최소한의 세팅으로 LM을 학습하기 위한 샘플코드☆59Updated 2 years ago
- 한국어 LLM 리더보드 및 모델 성능/안전성 관리☆22Updated 2 years ago
- ☆36Updated 2 years ago
- CareCall for Seniors: Role Specified Open-Domain Dialogue dataset generated by leveraging LLMs (NAACL 2022).☆60Updated 3 years ago
- 한국어 T5 모델☆55Updated 4 years ago
- StrategyQA 데이터 세트 번역☆23Updated last year
- ☆107Updated 2 years ago
- CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Korean☆47Updated last year
- 한국어 언어 모델 학습을 위한 프로젝트(Flax, Pytorch with Huggingface Accelerate)☆32Updated 2 years ago
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Models☆25Updated last year
- ☆19Updated 2 years ago
- Adversarial Test Dataset for Korean Multi-turn Response Selection☆34Updated 4 years ago
- ☆19Updated 3 years ago
- [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation☆28Updated 3 years ago
- ☆30Updated 3 years ago
- data related codebase for polyglot project☆18Updated 2 years ago
- kogpt를 oslo로 파인튜닝하는 예제.☆23Updated 3 years ago
- Train GEMMA on TPU/GPU! (Codebase for training Gemma-Ko Series)☆48Updated last year
- Difference-based Contrastive Learning for Korean Sentence Embeddings☆24Updated 2 years ago
- Forked repo from https://github.com/EleutherAI/lm-evaluation-harness/commit/1f66adc☆81Updated last year
- The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)☆119Updated 5 years ago
- ☆19Updated 5 years ago
- 자체 구축한 한국어 평가 데이터셋을 이용한 한국어 모델 평가☆31Updated last year
- Korean-English Bilingual Electra Models☆110Updated 4 years ago