Alternatives and similar repositories for 2021Langcon

Users that are interested in 2021Langcon are comparing it to the libraries listed below

• JoungheeKim / kor-spacing

  View on GitHub
  This is project for korean auto spacing
  ☆12Aug 3, 2020Updated 5 years ago
• noowad93 / chosung-translator

  View on GitHub
  초성 해석기 based on ko-BART
  ☆29Mar 31, 2021Updated 4 years ago
• ko-nlp / moducorpus-sanitizer

  View on GitHub
  모두의 말뭉치 데이터를 분석에 편리한 형태로 변환하는 기능을 제공합니다.
  ☆11Mar 2, 2022Updated 3 years ago
• triplet02 / KoNPron

  View on GitHub
  Convert Numerical Representations to Korean Pronunciation
  ☆14Apr 20, 2020Updated 5 years ago
• korean-named-entity / konec

  View on GitHub
  Korean Named Entity Corpus
  ☆25May 12, 2023Updated 2 years ago
• monologg / ko_lm_dataformat

  View on GitHub
  A utility for storing and reading files for Korean LM training 💾
  ☆35Oct 15, 2025Updated 4 months ago
• hamanlp / hama-py

  View on GitHub
  🦛 파이썬 한글 처리 라이브러리. Python Korean Morphological Analyzer
  ☆19Feb 4, 2025Updated last year
• jeongukjae / korean-wikipedia-corpus

  View on GitHub
  문장단위로 분절된 한국어 위키피디아 코퍼스. Releases에서 다운로드 받거나 tfds-korean으로 사용해주세요.
  ☆24Sep 6, 2023Updated 2 years ago
• J-Seo / KommonGen

  View on GitHub
  한국어 생성 모델의 상식 추론을 위한 KommonGen 데이터셋입니다.
  ☆17Oct 5, 2021Updated 4 years ago
• YongWookHa / kor-text-preprocess

  View on GitHub
  Korean text data preprocess toolkit for NLP
  ☆18Jun 11, 2019Updated 6 years ago
• dobby-seo / kosr

  View on GitHub
  Korean speech recognition based on transformer (트랜스포머 기반 한국어 음성 인식)
  ☆31Feb 19, 2021Updated 4 years ago
• openkorpos / model-mecab

  View on GitHub
  MeCab model trained with OpenKorPos.
  ☆23Jun 19, 2022Updated 3 years ago
• jinmang2 / AdvancedTransformers

  View on GitHub
  ⛩ All about Korean Transformers (information and tutorial)
  ☆19Jun 21, 2022Updated 3 years ago
• kakaoenterprise / KorAdvMRSTestData

  View on GitHub
  Adversarial Test Dataset for Korean Multi-turn Response Selection
  ☆34Dec 16, 2021Updated 4 years ago
• tunib-ai / artwork_captions

  View on GitHub
  Machine Generated Captions for Best Artworks
  ☆22Sep 21, 2022Updated 3 years ago
• baikalai / baikal-bert

  View on GitHub
  baikal.ai's pre-trained BERT models: descriptions and sample codes
  ☆12Jun 24, 2021Updated 4 years ago
• lovit / namuwikitext

  View on GitHub
  Wikitext format dataset of Namuwiki (Most famous Korean wikipedia)
  ☆53Oct 25, 2020Updated 5 years ago
• nlpai-lab / Korean-CommonGen

  View on GitHub
  [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation
  ☆11May 27, 2022Updated 3 years ago
• catSirup / naver_kin_crawling

  View on GitHub
  네이버 지식인 크롤링
  ☆35Feb 7, 2020Updated 6 years ago
• JoJo0217 / rlhf_korean_dataset

  View on GitHub
  For the rlhf learning environment of Koreans
  ☆25Sep 25, 2023Updated 2 years ago
• jason9693 / oslo-kogpt-finetunig

  View on GitHub
  kogpt를 oslo로 파인튜닝하는 예제.
  ☆23Aug 26, 2022Updated 3 years ago
• BitnaKeum / Web_Crawler

  View on GitHub
  나무위키, 위키피디아, 다음블로그, 티스토리, 유튜브, 네이트판 크롤러
  ☆12Jul 21, 2021Updated 4 years ago
• songys / AwesomeKorean_Speech

  View on GitHub
  음성인식과 신호처리
  ☆14Sep 12, 2021Updated 4 years ago
• digitalprk / north_korean_embeddings

  View on GitHub
  Word2Vec Word Vectors trained on a North Korean Corpus / 조선어 (북한어) 단어 임베딩
  ☆13Apr 22, 2022Updated 3 years ago
• passing2961 / EmoNSMC

  View on GitHub
  Korean large emotion labeled dataset (EmoNSMC)
  ☆14Mar 5, 2020Updated 5 years ago
• snunlp / KR-ELECTRA

  View on GitHub
  KoRean based ELECTRA pre-trained models (KR-ELECTRA) for Tensorflow and PyTorch
  ☆15Feb 13, 2022Updated 4 years ago
• hyunwoongko / megatron-11b

  View on GitHub
  Megatron LM 11B on Huggingface Transformers
  ☆27Jul 11, 2021Updated 4 years ago
• hyunwoongko / python-mecab-kor

  View on GitHub
  Yet another python binding for mecab-ko
  ☆88May 16, 2023Updated 2 years ago
• moon1ite / yajatime

  View on GitHub
  야자타임 (a.k.a. 야밤의 자연어처리 타임)
  ☆27Mar 31, 2021Updated 4 years ago
• hkjeon13 / noising-korean

  View on GitHub
  한국어 문서에 노이즈를 추가합니다.
  ☆27Nov 9, 2022Updated 3 years ago
• naver-ai / carecall-corpus

  View on GitHub
  CareCall for Seniors: Role Specified Open-Domain Dialogue dataset generated by leveraging LLMs (NAACL 2022).
  ☆60May 3, 2022Updated 3 years ago
• lovit / petitions_archive

  View on GitHub
  청와대 국민청원 데이터 아카이브
  ☆15Aug 29, 2020Updated 5 years ago
• seopbo / nlp_tutorials

  View on GitHub
  huggingface를 이용하여 downstream task 수행하기
  ☆62Dec 28, 2021Updated 4 years ago
• nawnoes / pytorch-gpt-x

  View on GitHub
  An implementation of an autoregressive language model using an improved Transformer and DeepSpeed pipeline parallelism.
  ☆30Jan 12, 2026Updated last month
• korean-named-entity / konne

  View on GitHub
  Korean Nested Named Entity Corpus
  ☆20May 13, 2023Updated 2 years ago
• jooinjang / Ko-ATOMIC

  View on GitHub
  Korean Commonsense Knowledge Graph
  ☆15Dec 23, 2022Updated 3 years ago
• deepspeedai / deepspeed-gpt-neox

  View on GitHub
  An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
  ☆21Nov 28, 2022Updated 3 years ago
• seujung / kolang-t5-base

  View on GitHub
  T5-base model for Korean
  ☆27May 20, 2021Updated 4 years ago
• lovit / kowikitext

  View on GitHub
  ☆19Jan 17, 2021Updated 5 years ago