The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)
☆119Oct 8, 2020Updated 6 years ago
Alternatives and similar repositories for kortok
Users that are interested in kortok are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation☆11May 27, 2022Updated 4 years ago
- 한국어 문서에 노이즈를 추가합니다.☆27Nov 9, 2022Updated 4 years ago
- BERTScore for Korean☆81Feb 22, 2024Updated 2 years ago
- 모두의 말뭉치 데이터를 분석에 편리한 형태로 변환하는 기능을 제공합니다.☆11Mar 2, 2022Updated 4 years ago
- Pretrained ELECTRA Model for Korean☆641Feb 19, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 📖 Korean NLU Benchmark☆606Jun 30, 2026Updated 4 months ago
- Training Transformers of Huggingface with KoNLPy☆68Aug 28, 2020Updated 6 years ago
- A utility for storing and reading files for Korean LM training 💾☆35Jul 18, 2026Updated 3 months ago
- Finetuning Pipeline☆89Feb 25, 2022Updated 4 years ago
- Character-level Korean ELECTRA Model (음절 단위 한국어 ELECTRA)☆55Jun 12, 2023Updated 3 years ago
- baikal.ai's pre-trained BERT models: descriptions and sample codes☆12Jun 24, 2021Updated 5 years ago
- 초성 해석기 based on ko-BART☆29Mar 31, 2021Updated 5 years ago
- 🤗 Pretrained BERT model & WordPiece tokenizer trained on Korean Comments 한국어 댓글로 프리트레이닝한 BERT 모델과 데이터셋☆497Nov 7, 2022Updated 4 years ago
- Open Korean NLP Dataset Curation for the Users All Around the Globe☆164Jun 17, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- KorNLI and KorSTS: New Benchmark Datasets for Korean Natural Language Understanding☆316Jul 9, 2023Updated 3 years ago
- Tokenizer 비교 실험☆11Jan 3, 2022Updated 4 years ago
- ☆198May 22, 2023Updated 3 years ago
- Korean Visual Question Answering☆59Feb 18, 2020Updated 6 years ago
- Sentence Embeddings using Siamese ETRI KoBERT☆162Aug 16, 2025Updated last year
- Korean corpus repository☆760Oct 3, 2022Updated 4 years ago
- 문장단위로 분절된 한국어 위키피디아 코퍼스. Releases에서 다운로드 받거나 tfds-korean으로 사용해주세요.☆24Sep 6, 2023Updated 3 years ago
- Korean HateSpeech Dataset☆400Jul 18, 2020Updated 6 years ago
- ELECTRA기반 한국어 대화체 언어모델☆54Aug 4, 2021Updated 5 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- 🦛 파이썬 한글 처리 라이브러리. Python Korean Morphological Analyzer☆19Feb 4, 2025Updated last year
- 🦅 Pretrained BigBird Model for Korean (up to 4096 tokens)☆201Dec 28, 2023Updated 2 years ago
- 한국어 데이터 세트 링크☆931Jun 17, 2026Updated 5 months ago
- 11.5기의 beyondBERT의 토론 내용을 정리하는 repository입니다.☆57Jul 2, 2020Updated 6 years ago
- Korean BERT model using character tokenizer☆27Apr 8, 2021Updated 5 years ago
- KoRean based BERT pre-trained models (KR-BERT) for Tensorflow and PyTorch☆209Apr 24, 2024Updated 2 years ago
- Kobart model on Huggingface transformers☆64Feb 15, 2022Updated 4 years ago
- Subword-level Word Vector Representations for Korean (ACL 2018)☆107Oct 17, 2019Updated 7 years ago
- Adversarial Test Dataset for Korean Multi-turn Response Selection☆34Dec 16, 2021Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Parallel dataset of Korean Questions and Commands☆62Mar 24, 2023Updated 3 years ago
- 야자타임 (a.k.a. 야밤의 자연어처리 타임)☆27Mar 31, 2021Updated 5 years ago
- 국내 자연어 처리 기술을 연구 및 개발하는 스타트업 목록☆163May 10, 2020Updated 6 years ago
- 문장단위로 분절된 나무위키 데이터셋. Releases에서 다운로드 받거나, tfds-korean을 통해 다운로드 받으세요.☆19Jun 16, 2021Updated 5 years ago
- Korean Named Entity Corpus☆26May 12, 2023Updated 3 years ago
- ⛩ All about Korean Transformers (information and tutorial)☆17Jun 21, 2022Updated 4 years ago
- [2021 훈민정음 한국어 음성•자연어 인공지능 경진대회] 대화요약 부문 알라꿍달라꿍 팀의 대화요약 학습 및 추론 코드를 공유하기 위한 레포입니다.☆127Jul 11, 2022Updated 4 years ago
Are these results useful?