EleutherAI / dpsLinks
Data processing system for polyglot
β93Updated 2 years ago
Alternatives and similar repositories for dps
Users that are interested in dps are comparing it to the libraries listed below
Sorting:
- β32Updated 2 years ago
- π€ μ΅μνμ μΈν μΌλ‘ LMμ νμ΅νκΈ° μν μνμ½λβ58Updated 2 years ago
- bpe based korean t5 model for text-to-text unified frameworkβ63Updated last year
- νκ΅μ΄ LLM 리λ보λ λ° λͺ¨λΈ μ±λ₯/μμ μ± κ΄λ¦¬β22Updated 2 years ago
- Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasetsβ131Updated 3 years ago
- Official repository for KoMT-Bench built by LG AI Researchβ71Updated last year
- νκ΅μ΄ T5 λͺ¨λΈβ55Updated 4 years ago
- CareCall for Seniors: Role Specified Open-Domain Dialogue dataset generated by leveraging LLMs (NAACL 2022).β61Updated 3 years ago
- β19Updated 3 years ago
- β36Updated 2 years ago
- [Google Meet] MLLM Arxiv Casual Talkβ52Updated 2 years ago
- Korean Math Word Problemsβ59Updated 3 years ago
- β19Updated 2 years ago
- νκ΅μ΄ μΈμ΄ λͺ¨λΈ νμ΅μ μν νλ‘μ νΈ(Flax, Pytorch with Huggingface Accelerate)β33Updated 2 years ago
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Modelsβ25Updated last year
- kogptλ₯Ό osloλ‘ νμΈνλνλ μμ .β23Updated 3 years ago
- [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluationβ28Updated 3 years ago
- Adversarial Test Dataset for Korean Multi-turn Response Selectionβ35Updated 4 years ago
- A utility for storing and reading files for Korean LM training πΎβ36Updated 2 months ago
- StrategyQA λ°μ΄ν° μΈνΈ λ²μβ23Updated last year
- Difference-based Contrastive Learning for Korean Sentence Embeddingsβ24Updated 2 years ago
- CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Koreanβ47Updated last year
- Reward Modelμ μ΄μ©νμ¬ μΈμ΄λͺ¨λΈμ λ΅λ³μ νκ°νκΈ°β29Updated last year
- β107Updated 2 years ago
- β30Updated 3 years ago
- KOLD: Korean Offensive Language Datasetβ82Updated 3 years ago
- For the rlhf learning environment of Koreansβ25Updated 2 years ago
- β19Updated 4 years ago
- T5-base model for Koreanβ27Updated 4 years ago
- data related codebase for polyglot projectβ18Updated 2 years ago