EleutherAI / dpsLinks
Data processing system for polyglot
β92Updated 2 years ago
Alternatives and similar repositories for dps
Users that are interested in dps are comparing it to the libraries listed below
Sorting:
- bpe based korean t5 model for text-to-text unified frameworkβ63Updated last year
- π€ μ΅μνμ μΈν μΌλ‘ LMμ νμ΅νκΈ° μν μνμ½λβ58Updated 2 years ago
- Official repository for KoMT-Bench built by LG AI Researchβ68Updated last year
- νκ΅μ΄ T5 λͺ¨λΈβ54Updated 3 years ago
- β32Updated 2 years ago
- νκ΅μ΄ LLM 리λ보λ λ° λͺ¨λΈ μ±λ₯/μμ μ± κ΄λ¦¬β22Updated last year
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Modelsβ25Updated last year
- Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasetsβ131Updated 2 years ago
- Korean Math Word Problemsβ59Updated 3 years ago
- β36Updated last year
- β19Updated 2 years ago
- νκ΅μ΄ μΈμ΄ λͺ¨λΈ νμ΅μ μν νλ‘μ νΈ(Flax, Pytorch with Huggingface Accelerate)β33Updated 2 years ago
- Adversarial Test Dataset for Korean Multi-turn Response Selectionβ35Updated 3 years ago
- β28Updated 2 years ago
- CareCall for Seniors: Role Specified Open-Domain Dialogue dataset generated by leveraging LLMs (NAACL 2022).β60Updated 3 years ago
- kogptλ₯Ό osloλ‘ νμΈνλνλ μμ .β23Updated 3 years ago
- [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluationβ27Updated 2 years ago
- β19Updated last year
- [Google Meet] MLLM Arxiv Casual Talkβ52Updated 2 years ago
- β107Updated 2 years ago
- CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Koreanβ46Updated 8 months ago
- β36Updated last year
- Reward Modelμ μ΄μ©νμ¬ μΈμ΄λͺ¨λΈμ λ΅λ³μ νκ°νκΈ°β29Updated last year
- StrategyQA λ°μ΄ν° μΈνΈ λ²μβ22Updated last year
- Difference-based Contrastive Learning for Korean Sentence Embeddingsβ25Updated 2 years ago
- Character-level Korean ELECTRA Model (μμ λ¨μ νκ΅μ΄ ELECTRA)β54Updated 2 years ago
- Dataset of Korean Threatening Conversationsβ74Updated 2 years ago
- The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)β119Updated 4 years ago
- A utility for storing and reading files for Korean LM training πΎβ36Updated last year
- data related codebase for polyglot projectβ18Updated 2 years ago