Alternatives and similar repositories for nlp-datasets

Users that are interested in nlp-datasets are comparing it to the libraries listed below

• hyunwoongko / bert2bert-summarization

  View on GitHub
  Abstractive summarization using Bert2Bert framework.
  ☆31Dec 5, 2020Updated 5 years ago
• hyunwoongko / kobart-transformers

  View on GitHub
  Kobart model on Huggingface transformers
  ☆64Feb 15, 2022Updated 4 years ago
• hyunwoongko / dialobot

  View on GitHub
  Opensource chatbot framework
  ☆16Aug 1, 2021Updated 4 years ago
• hyunwoongko / beyond-lm

  View on GitHub
  Beyond LM: How can language model go forward in the future?
  ☆15Apr 30, 2023Updated 2 years ago
• hyunwoongko / megatron-11b

  View on GitHub
  Megatron LM 11B on Huggingface Transformers
  ☆27Jul 11, 2021Updated 4 years ago
• Beomi / easy-lm-trainer

  View on GitHub
  🤗 최소한의 세팅으로 LM을 학습하기 위한 샘플코드
  ☆59May 23, 2023Updated 2 years ago
• jason9693 / oslo-kogpt-finetunig

  View on GitHub
  kogpt를 oslo로 파인튜닝하는 예제.
  ☆23Aug 26, 2022Updated 3 years ago
• human-rights-corpus / HRC

  View on GitHub
  #인권코퍼스
  ☆31Oct 6, 2023Updated 2 years ago
• tunib-ai / KMWP

  View on GitHub
  Korean Math Word Problems
  ☆59Jan 14, 2022Updated 4 years ago
• tunib-ai / tunib-electra

  View on GitHub
  Korean-English Bilingual Electra Models
  ☆110Nov 22, 2021Updated 4 years ago
• lovit / KoBERTScore

  View on GitHub
  BERTScore for Korean
  ☆80Feb 22, 2024Updated last year
• momozzing / kiosk_bot

  View on GitHub
  KoGPT-2 finetuning Based Kiosk chatbot
  ☆12Dec 12, 2023Updated 2 years ago
• hyunwoongko / stop-sequencer

  View on GitHub
  Implementation of stop sequencer for Huggingface Transformers
  ☆16Jun 6, 2023Updated 2 years ago
• ko-nlp / moducorpus-sanitizer

  View on GitHub
  모두의 말뭉치 데이터를 분석에 편리한 형태로 변환하는 기능을 제공합니다.
  ☆11Mar 2, 2022Updated 3 years ago
• tunib-ai / DKTC

  View on GitHub
  Dataset of Korean Threatening Conversations
  ☆72Nov 1, 2022Updated 3 years ago
• LG-NLP / KorWikiTableQuestions

  View on GitHub
  This repo is for Korean wiki table question answering datasets described in the paper of Korean-Specific Dataset for Table Question Answe…
  ☆91Oct 22, 2024Updated last year
• ko-nlp / Open-korean-corpora

  View on GitHub
  Open Korean NLP Dataset Curation for the Users All Around the Globe
  ☆152Nov 18, 2023Updated 2 years ago
• HeegyuKim / open-korean-instructions

  View on GitHub
  언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.
  ☆452Apr 13, 2025Updated 10 months ago
• nlpai-lab / Korean-CommonGen

  View on GitHub
  [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation
  ☆11May 27, 2022Updated 3 years ago
• ratsgo / nlpbook

  View on GitHub
  pratical tips for Natural Language Processing
  ☆98Oct 6, 2022Updated 3 years ago
• kakaobrain / kor-nlu-datasets

  View on GitHub
  KorNLI and KorSTS: New Benchmark Datasets for Korean Natural Language Understanding
  ☆309Jul 9, 2023Updated 2 years ago
• kakaobrain / kortok

  View on GitHub
  The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)
  ☆119Oct 8, 2020Updated 5 years ago
• monologg / KoBigBird

  View on GitHub
  🦅 Pretrained BigBird Model for Korean (up to 4096 tokens)
  ☆201Dec 28, 2023Updated 2 years ago
• hyunwoongko / kss

  View on GitHub
  KSS: Korean String processing Suite
  ☆468Nov 13, 2025Updated 3 months ago
• KLUE-benchmark / KLUE-baseline

  View on GitHub
  Finetuning Pipeline
  ☆89Feb 25, 2022Updated 3 years ago
• smilegate-ai / HuLiC

  View on GitHub
  ☆92Mar 3, 2022Updated 3 years ago
• jason9693 / polyglot-finetuning-oslo

  View on GitHub
  ☆19Sep 20, 2022Updated 3 years ago
• monologg / ko_lm_dataformat

  View on GitHub
  A utility for storing and reading files for Korean LM training 💾
  ☆35Oct 15, 2025Updated 4 months ago
• songys / AwesomeKorean_Data

  View on GitHub
  한국어 데이터 세트 링크
  ☆900Oct 14, 2024Updated last year
• soeque1 / KoGPT2-DINO

  View on GitHub
  ☆19Apr 1, 2022Updated 3 years ago
• ko-nlp / Korpora

  View on GitHub
  Korean corpus repository
  ☆739Oct 3, 2022Updated 3 years ago
• LostCow / KLUE

  View on GitHub
  KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)
  ☆25Apr 11, 2022Updated 3 years ago
• tunib-ai / artwork_captions

  View on GitHub
  Machine Generated Captions for Best Artworks
  ☆22Sep 21, 2022Updated 3 years ago
• monologg / KoCharELECTRA

  View on GitHub
  Character-level Korean ELECTRA Model (음절 단위 한국어 ELECTRA)
  ☆54Jun 12, 2023Updated 2 years ago
• monologg / KoELECTRA

  View on GitHub
  Pretrained ELECTRA Model for Korean
  ☆630Feb 19, 2024Updated last year
• hyunwoongko / citrus-pest-disease-recognition

  View on GitHub
  Citrus pest disease recognition app based on deep learning
  ☆10Jun 1, 2020Updated 5 years ago
• metterian / korean_bert_score

  View on GitHub
  BERT score for text generation
  ☆12Jan 15, 2025Updated last year
• wisenut-research / KoT5

  View on GitHub
  한국어 T5 모델
  ☆54Dec 7, 2021Updated 4 years ago
• noowad93 / chosung-translator

  View on GitHub
  초성 해석기 based on ko-BART
  ☆29Mar 31, 2021Updated 4 years ago