EleutherAI / dpsLinks
Data processing system for polyglot
β92Updated 2 years ago
Alternatives and similar repositories for dps
Users that are interested in dps are comparing it to the libraries listed below
Sorting:
- bpe based korean t5 model for text-to-text unified frameworkβ63Updated last year
- π€ μ΅μνμ μΈν μΌλ‘ LMμ νμ΅νκΈ° μν μνμ½λβ58Updated 2 years ago
- β32Updated 2 years ago
- Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasetsβ131Updated 3 years ago
- Official repository for KoMT-Bench built by LG AI Researchβ70Updated last year
- νκ΅μ΄ LLM 리λ보λ λ° λͺ¨λΈ μ±λ₯/μμ μ± κ΄λ¦¬β22Updated 2 years ago
- νκ΅μ΄ T5 λͺ¨λΈβ55Updated 3 years ago
- β36Updated 2 years ago
- Korean Math Word Problemsβ59Updated 3 years ago
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Modelsβ25Updated last year
- [Google Meet] MLLM Arxiv Casual Talkβ52Updated 2 years ago
- CareCall for Seniors: Role Specified Open-Domain Dialogue dataset generated by leveraging LLMs (NAACL 2022).β61Updated 3 years ago
- β19Updated 3 years ago
- StrategyQA λ°μ΄ν° μΈνΈ λ²μβ22Updated last year
- Adversarial Test Dataset for Korean Multi-turn Response Selectionβ35Updated 3 years ago
- [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluationβ28Updated 2 years ago
- CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Koreanβ47Updated 10 months ago
- μ체 ꡬμΆν νκ΅μ΄ νκ° λ°μ΄ν°μ μ μ΄μ©ν νκ΅μ΄ λͺ¨λΈ νκ°β31Updated last year
- data related codebase for polyglot projectβ18Updated 2 years ago
- β19Updated 2 years ago
- Difference-based Contrastive Learning for Korean Sentence Embeddingsβ24Updated 2 years ago
- Forked repo from https://github.com/EleutherAI/lm-evaluation-harness/commit/1f66adcβ80Updated last year
- kogptλ₯Ό osloλ‘ νμΈνλνλ μμ .β23Updated 3 years ago
- Yet another python binding for mecab-koβ88Updated 2 years ago
- β30Updated 2 years ago
- β107Updated 2 years ago
- The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)β120Updated 5 years ago
- β10Updated 5 months ago
- For the rlhf learning environment of Koreansβ25Updated 2 years ago
- Reward Modelμ μ΄μ©νμ¬ μΈμ΄λͺ¨λΈμ λ΅λ³μ νκ°νκΈ°β29Updated last year