kakaobrain/kortok external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

kakaobrain/kortok

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/kakaobrain/kortok)

Close

kakaobrain / kortokView on GitHubMore

• External links
• Readme badge

The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)

☆119Oct 8, 2020Updated 5 years ago

Alternatives and similar repositories for kortok

Users that are interested in kortok are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• nlpai-lab / Korean-CommonGen

  View on GitHub
  [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation
  ☆11May 27, 2022Updated 3 years ago
• monologg / ko_lm_dataformat

  View on GitHub
  A utility for storing and reading files for Korean LM training 💾
  ☆35Oct 15, 2025Updated 5 months ago
• ko-nlp / moducorpus-sanitizer

  View on GitHub
  모두의 말뭉치 데이터를 분석에 편리한 형태로 변환하는 기능을 제공합니다.
  ☆11Mar 2, 2022Updated 4 years ago
• hkjeon13 / noising-korean

  View on GitHub
  한국어 문서에 노이즈를 추가합니다.
  ☆27Nov 9, 2022Updated 3 years ago
• lovit / KoBERTScore

  View on GitHub
  BERTScore for Korean
  ☆80Feb 22, 2024Updated 2 years ago
• DigitalOcean Gradient AI Platform • Ad
  Build production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
• baikalai / baikal-bert

  View on GitHub
  baikal.ai's pre-trained BERT models: descriptions and sample codes
  ☆12Jun 24, 2021Updated 4 years ago
• lovit / huggingface_konlpy

  View on GitHub
  Training Transformers of Huggingface with KoNLPy
  ☆68Aug 28, 2020Updated 5 years ago
• monologg / KoCharELECTRA

  View on GitHub
  Character-level Korean ELECTRA Model (음절 단위 한국어 ELECTRA)
  ☆54Jun 12, 2023Updated 2 years ago
• noowad93 / chosung-translator

  View on GitHub
  초성 해석기 based on ko-BART
  ☆29Mar 31, 2021Updated 4 years ago
• ko-nlp / Open-korean-corpora

  View on GitHub
  Open Korean NLP Dataset Curation for the Users All Around the Globe
  ☆152Nov 18, 2023Updated 2 years ago
• KLUE-benchmark / KLUE

  View on GitHub
  📖 Korean NLU Benchmark
  ☆589Jul 6, 2022Updated 3 years ago
• KLUE-benchmark / KLUE-baseline

  View on GitHub
  Finetuning Pipeline
  ☆89Feb 25, 2022Updated 4 years ago
• kakaobrain / kor-nlu-datasets

  View on GitHub
  KorNLI and KorSTS: New Benchmark Datasets for Korean Natural Language Understanding
  ☆310Jul 9, 2023Updated 2 years ago
• SKTBrain / KVQA

  View on GitHub
  Korean Visual Question Answering
  ☆59Feb 18, 2020Updated 6 years ago
• DigitalOcean Gradient AI Platform • Ad
  Build production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
• SungjoonPark / KoreanWordVectors

  View on GitHub
  Subword-level Word Vector Representations for Korean (ACL 2018)
  ☆107Oct 17, 2019Updated 6 years ago
• monologg / KoELECTRA

  View on GitHub
  Pretrained ELECTRA Model for Korean
  ☆630Feb 19, 2024Updated 2 years ago
• Beomi / KcBERT

  View on GitHub
  🤗 Pretrained BERT model & WordPiece tokenizer trained on Korean Comments 한국어 댓글로 프리트레이닝한 BERT 모델과 데이터셋
  ☆493Nov 7, 2022Updated 3 years ago
• moon1ite / yajatime

  View on GitHub
  야자타임 (a.k.a. 야밤의 자연어처리 타임)
  ☆27Mar 31, 2021Updated 4 years ago
• Huffon / nlp-startups

  View on GitHub
  국내 자연어 처리 기술을 연구 및 개발하는 스타트업 목록
  ☆165May 10, 2020Updated 5 years ago
• songys / AwesomeKorean_Data

  View on GitHub
  한국어 데이터 세트 링크
  ☆908Oct 14, 2024Updated last year
• BM-K / KoSentenceBERT-ETRI

  View on GitHub
  Sentence Embeddings using Siamese ETRI KoBERT
  ☆162Aug 16, 2025Updated 7 months ago
• jeongukjae / namuwiki-corpus

  View on GitHub
  문장단위로 분절된 나무위키 데이터셋. Releases에서 다운로드 받거나, tfds-korean을 통해 다운로드 받으세요.
  ☆19Jun 16, 2021Updated 4 years ago
• triplet02 / KoNPron

  View on GitHub
  Convert Numerical Representations to Korean Pronunciation
  ☆14Apr 20, 2020Updated 5 years ago
• GPU virtual machines on DigitalOcean Gradient AI • Ad
  Get to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
• modulabs / beyondBERT

  View on GitHub
  11.5기의 beyondBERT의 토론 내용을 정리하는 repository입니다.
  ☆57Jul 2, 2020Updated 5 years ago
• kocohub / korean-hate-speech

  View on GitHub
  Korean HateSpeech Dataset
  ☆395Jul 18, 2020Updated 5 years ago
• cosmoquester / 2021-dialogue-summary-competition

  View on GitHub
  [2021 훈민정음 한국어 음성•자연어 인공지능 경진대회] 대화요약 부문 알라꿍달라꿍 팀의 대화요약 학습 및 추론 코드를 공유하기 위한 레포입니다.
  ☆128Jul 11, 2022Updated 3 years ago
• jeongukjae / korean-wikipedia-corpus

  View on GitHub
  문장단위로 분절된 한국어 위키피디아 코퍼스. Releases에서 다운로드 받거나 tfds-korean으로 사용해주세요.
  ☆24Sep 6, 2023Updated 2 years ago
• jungyeul / korean-parallel-corpora

  View on GitHub
  Korean Parallel Corpus
  ☆147Feb 24, 2024Updated 2 years ago
• monologg / KoBigBird

  View on GitHub
  🦅 Pretrained BigBird Model for Korean (up to 4096 tokens)
  ☆202Dec 28, 2023Updated 2 years ago
• ko-nlp / Korpora

  View on GitHub
  Korean corpus repository
  ☆745Oct 3, 2022Updated 3 years ago
• Beomi / easy-lm-trainer

  View on GitHub
  🤗 최소한의 세팅으로 LM을 학습하기 위한 샘플코드
  ☆59May 23, 2023Updated 2 years ago
• kakaoenterprise / KorAdvMRSTestData

  View on GitHub
  Adversarial Test Dataset for Korean Multi-turn Response Selection
  ☆34Dec 16, 2021Updated 4 years ago
• Virtual machines for every use case on DigitalOcean • Ad
  Get dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
• ModuNLP / hacking_transformers

  View on GitHub
  ☆11Aug 12, 2020Updated 5 years ago
• warnikchow / paraKQC

  View on GitHub
  Parallel dataset of Korean Questions and Commands
  ☆60Mar 24, 2023Updated 3 years ago
• snunlp / KR-BERT

  View on GitHub
  KoRean based BERT pre-trained models (KR-BERT) for Tensorflow and PyTorch
  ☆211Apr 24, 2024Updated last year
• cynthia / kosentences

  View on GitHub
  Large scale unannotated Korean corpus for unsupervised tasks. (e.g. Language modeling)
  ☆28Aug 11, 2019Updated 6 years ago
• EleutherAI / polyglot

  View on GitHub
  Polyglot: Large Language Models of Well-balanced Competence in Multi-languages
  ☆484Aug 22, 2023Updated 2 years ago
• taeminlee / KoGPT2-Transformers

  View on GitHub
  KoGPT2 on Huggingface Transformers
  ☆33May 4, 2021Updated 4 years ago
• jason9693 / oslo-kogpt-finetunig

  View on GitHub
  kogpt를 oslo로 파인튜닝하는 예제.
  ☆23Aug 26, 2022Updated 3 years ago