EleutherAI / dpsLinks
Data processing system for polyglot
β92Updated 2 years ago
Alternatives and similar repositories for dps
Users that are interested in dps are comparing it to the libraries listed below
Sorting:
- bpe based korean t5 model for text-to-text unified frameworkβ63Updated last year
- π€ μ΅μνμ μΈν μΌλ‘ LMμ νμ΅νκΈ° μν μνμ½λβ58Updated 2 years ago
- Official repository for KoMT-Bench built by LG AI Researchβ69Updated last year
- Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasetsβ131Updated 2 years ago
- Korean Math Word Problemsβ59Updated 3 years ago
- νκ΅μ΄ T5 λͺ¨λΈβ54Updated 3 years ago
- β32Updated 2 years ago
- νκ΅μ΄ LLM 리λ보λ λ° λͺ¨λΈ μ±λ₯/μμ μ± κ΄λ¦¬β22Updated 2 years ago
- β36Updated 2 years ago
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Modelsβ25Updated last year
- [Google Meet] MLLM Arxiv Casual Talkβ52Updated 2 years ago
- νκ΅μ΄ μΈμ΄ λͺ¨λΈ νμ΅μ μν νλ‘μ νΈ(Flax, Pytorch with Huggingface Accelerate)β33Updated 2 years ago
- CareCall for Seniors: Role Specified Open-Domain Dialogue dataset generated by leveraging LLMs (NAACL 2022).β60Updated 3 years ago
- β19Updated 3 years ago
- β107Updated 2 years ago
- data related codebase for polyglot projectβ18Updated 2 years ago
- β29Updated 2 years ago
- CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Koreanβ47Updated 9 months ago
- Adversarial Test Dataset for Korean Multi-turn Response Selectionβ35Updated 3 years ago
- Forked repo from https://github.com/EleutherAI/lm-evaluation-harness/commit/1f66adcβ80Updated last year
- Dataset of Korean Threatening Conversationsβ74Updated 2 years ago
- β19Updated last year
- μ체 ꡬμΆν νκ΅μ΄ νκ° λ°μ΄ν°μ μ μ΄μ©ν νκ΅μ΄ λͺ¨λΈ νκ°β31Updated last year
- Train GEMMA on TPU/GPU! (Codebase for training Gemma-Ko Series)β48Updated last year
- StrategyQA λ°μ΄ν° μΈνΈ λ²μβ22Updated last year
- kogptλ₯Ό osloλ‘ νμΈνλνλ μμ .β23Updated 3 years ago
- The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)β119Updated 5 years ago
- KOLD: Korean Offensive Language Datasetβ82Updated 2 years ago
- Character-level Korean ELECTRA Model (μμ λ¨μ νκ΅μ΄ ELECTRA)β54Updated 2 years ago
- Difference-based Contrastive Learning for Korean Sentence Embeddingsβ24Updated 2 years ago