jeongukjae/korean-wikipedia-corpus external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

jeongukjae/korean-wikipedia-corpus

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/jeongukjae/korean-wikipedia-corpus)

Close

jeongukjae / korean-wikipedia-corpusView on GitHubMore

• External links
• Readme badge

문장단위로 분절된 한국어 위키피디아 코퍼스. Releases에서 다운로드 받거나 tfds-korean으로 사용해주세요.

☆24Sep 6, 2023Updated 2 years ago

Alternatives and similar repositories for korean-wikipedia-corpus

Users that are interested in korean-wikipedia-corpus are comparing it to the libraries listed below

• songys / 2021Langcon

  View on GitHub
  ☆11Oct 3, 2021Updated 4 years ago
• machinereading / kor-re-gold

  View on GitHub
  Korean Relation Extraction Gold Standard
  ☆35May 31, 2021Updated 4 years ago
• jinmang2 / AdvancedTransformers

  View on GitHub
  ⛩ All about Korean Transformers (information and tutorial)
  ☆19Jun 21, 2022Updated 3 years ago
• JoungheeKim / kor-spacing

  View on GitHub
  This is project for korean auto spacing
  ☆12Aug 3, 2020Updated 5 years ago
• hanjanghoon / NLP_Koeran_DP

  View on GitHub
  2019 국어경진대회 한국어 의존구문 분석 대상(문체부 장관상)
  ☆15Oct 26, 2022Updated 3 years ago
• monologg / KoCharELECTRA

  View on GitHub
  Character-level Korean ELECTRA Model (음절 단위 한국어 ELECTRA)
  ☆54Jun 12, 2023Updated 2 years ago
• nlpai-lab / Korean-CommonGen

  View on GitHub
  [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation
  ☆11May 27, 2022Updated 3 years ago
• EleutherAI / hae-rae

  View on GitHub
  ☆33Aug 30, 2023Updated 2 years ago
• doublems / korean-bad-words

  View on GitHub
  I hope to this list will contribute good influence in Korean online services.
  ☆63Feb 10, 2019Updated 7 years ago
• ModuNLP / weekly-meeting

  View on GitHub
  매주 목요일, 20:00 모임
  ☆16Jul 24, 2020Updated 5 years ago
• taeminlee / KoGPT2-Transformers

  View on GitHub
  KoGPT2 on Huggingface Transformers
  ☆33May 4, 2021Updated 4 years ago
• monologg / ko_lm_dataformat

  View on GitHub
  A utility for storing and reading files for Korean LM training 💾
  ☆35Oct 15, 2025Updated 4 months ago
• lovit / namuwikitext

  View on GitHub
  Wikitext format dataset of Namuwiki (Most famous Korean wikipedia)
  ☆53Oct 25, 2020Updated 5 years ago
• lovit / KoBERTScore

  View on GitHub
  BERTScore for Korean
  ☆80Feb 22, 2024Updated 2 years ago
• seujung / t5-summarization

  View on GitHub
  ☆25Oct 28, 2020Updated 5 years ago
• songhyunje / kma

  View on GitHub
  Korean morphological analyzer
  ☆28Dec 22, 2019Updated 6 years ago
• lovit / sejong_corpus_cleaner

  View on GitHub
  세종 말뭉치 데이터를 정제하기 위한 utils
  ☆37Sep 30, 2019Updated 6 years ago
• J-Seo / KommonGen

  View on GitHub
  한국어 생성 모델의 상식 추론을 위한 KommonGen 데이터셋입니다.
  ☆17Oct 5, 2021Updated 4 years ago
• smilegate-ai / HuLiC

  View on GitHub
  ☆92Mar 3, 2022Updated 4 years ago
• ModuNLP / hacking_transformers

  View on GitHub
  ☆11Aug 12, 2020Updated 5 years ago
• monologg / dotfiles

  View on GitHub
  Simple setup for personal dotfiles
  ☆11Nov 29, 2025Updated 3 months ago
• cynthia / kosentences

  View on GitHub
  Large scale unannotated Korean corpus for unsupervised tasks. (e.g. Language modeling)
  ☆28Aug 11, 2019Updated 6 years ago
• lovit / kowikitext

  View on GitHub
  ☆19Jan 17, 2021Updated 5 years ago
• YongWookHa / kor-text-preprocess

  View on GitHub
  Korean text data preprocess toolkit for NLP
  ☆18Jun 11, 2019Updated 6 years ago
• kakaobrain / kortok

  View on GitHub
  The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)
  ☆119Oct 8, 2020Updated 5 years ago
• dobby-seo / kosr

  View on GitHub
  Korean speech recognition based on transformer (트랜스포머 기반 한국어 음성 인식)
  ☆31Feb 19, 2021Updated 5 years ago
• paust-team / pko-t5

  View on GitHub
  bpe based korean t5 model for text-to-text unified framework
  ☆63Apr 17, 2024Updated last year
• warnikchow / kosp2e

  View on GitHub
  Korean Speech to English Translation Corpus
  ☆45Sep 3, 2021Updated 4 years ago
• jeongukjae / namuwiki-corpus

  View on GitHub
  문장단위로 분절된 나무위키 데이터셋. Releases에서 다운로드 받거나, tfds-korean을 통해 다운로드 받으세요.
  ☆19Jun 16, 2021Updated 4 years ago
• BM-K / KoSentenceBERT_V2

  View on GitHub
  KoSentenceBERT 모델 구조 변경으로 성능 향상
  ☆10Nov 22, 2020Updated 5 years ago
• ko-nlp / Open-korean-corpora

  View on GitHub
  Open Korean NLP Dataset Curation for the Users All Around the Globe
  ☆152Nov 18, 2023Updated 2 years ago
• openkorpos / model-mecab

  View on GitHub
  MeCab model trained with OpenKorPos.
  ☆23Jun 19, 2022Updated 3 years ago
• KR-HappyFace / KoDALLE

  View on GitHub
  🇰🇷 Text to Image in Korean
  ☆85Jan 18, 2022Updated 4 years ago
• tunib-ai / tunib-electra

  View on GitHub
  Korean-English Bilingual Electra Models
  ☆110Nov 22, 2021Updated 4 years ago
• tunib-ai / artwork_captions

  View on GitHub
  Machine Generated Captions for Best Artworks
  ☆22Sep 21, 2022Updated 3 years ago
• korean-named-entity / konec

  View on GitHub
  Korean Named Entity Corpus
  ☆25May 12, 2023Updated 2 years ago
• MrBananaHuman / open-korean-instructions

  View on GitHub
  언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.
  ☆19Jul 16, 2023Updated 2 years ago
• SKplanet / Dialog-KoELECTRA

  View on GitHub
  ELECTRA기반 한국어 대화체 언어모델
  ☆53Aug 4, 2021Updated 4 years ago
• AIRC-KETI / ke-t5-downstreams

  View on GitHub
  ☆39Mar 25, 2024Updated last year