kakaobrain / kortok
The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)
☆118Updated 4 years ago
Alternatives and similar repositories for kortok:
Users that are interested in kortok are comparing it to the libraries listed below
- Korean-English Bilingual Electra Models☆110Updated 3 years ago
- Character-level Korean ELECTRA Model (음절 단위 한국어 ELECTRA)☆54Updated last year
- Kobart model on Huggingface transformers☆64Updated 3 years ago
- BERTScore for Korean☆77Updated last year
- Dataset of Korean Threatening Conversations☆73Updated 2 years ago
- Korean Relation Extraction Gold Standard☆35Updated 3 years ago
- Finetuning Pipeline☆90Updated 3 years ago
- KoBART chatbot☆47Updated 3 years ago
- Training Transformers of Huggingface with KoNLPy☆68Updated 4 years ago
- 한국어 개체명 정의 및 표지 표준화 기술보고서와 이를 기반으로 제작된 개체명 형태소 말뭉치☆91Updated 4 years ago
- Korean Math Word Problems☆58Updated 3 years ago
- huggingface를 이용하여 downstream task 수행하기☆64Updated 3 years ago
- 11.5기의 beyondBERT의 토론 내용을 정리하는 repository입니다.☆59Updated 4 years ago
- Parallel dataset of Korean Questions and Commands☆60Updated 2 years ago
- 🦅 Pretrained BigBird Model for Korean (up to 4096 tokens)☆202Updated last year
- KLUE 데이터를 활용한 HuggingFace Transformers 튜토리얼☆129Updated 3 years ago
- #Paired Question☆23Updated 4 years ago
- Data Augmentation Toolkit for Korean text.☆51Updated 3 years ago
- ELECTRA기반 한국어 대화체 언어모델☆54Updated 3 years ago
- 자연어 처리와 관련한 여러 튜토리얼 저장소☆79Updated 4 years ago
- https://ailabs.enliple.com/☆105Updated 4 years ago
- Simple Contrastive Learning of Korean Sentence Embeddings☆50Updated 2 years ago
- ☆73Updated 3 years ago
- Open Korean NLP Dataset Curation for the Users All Around the Globe☆147Updated last year
- Transformers Pipeline with KoELECTRA☆40Updated last year
- Korean ALBERT☆47Updated 5 years ago
- Baseline code for Korean open domain question answering(ODQA)☆76Updated last year
- 모두의 말뭉치 인공 지능 언어 능력 평가 1등 솔루션입니다.☆49Updated 3 years ago
- Korean Easy Data Augmentation☆94Updated 3 years ago
- [2021 훈민정음 한국어 음성•자연어 인공지능 경진대회] 대화요약 부문 알라꿍달라꿍 팀의 대화요약 학습 및 추론 코드를 공유하기 위한 레포입니다.☆128Updated 2 years ago