Alternatives and similar repositories for kowikitext:

Users that are interested in kowikitext are comparing it to the libraries listed below

• sionic-ai / Data_KoSuperNI
  StrategyQA 데이터 세트 번역
  ☆22Updated 11 months ago
• MrBananaHuman / PangyoCorpora
  ☆34Updated last year
• JoJo0217 / rlhf_korean_dataset
  For the rlhf learning environment of Koreans
  ☆23Updated last year
• jason9693 / oslo-kogpt-finetunig
  kogpt를 oslo로 파인튜닝하는 예제.
  ☆23Updated 2 years ago
• paust-team / pko-t5
  bpe based korean t5 model for text-to-text unified framework
  ☆63Updated 11 months ago
• J-Seo / Korean-CommonGen
  [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation
  ☆28Updated 2 years ago
• monologg / ko_lm_dataformat
  A utility for storing and reading files for Korean LM training 💾
  ☆37Updated last year
• seujung / kolang-t5-base
  T5-base model for Korean
  ☆26Updated 3 years ago
• hyunwoongko / beyond-lm
  Beyond LM: How can language model go forward in the future?
  ☆15Updated last year
• EleutherAI / hae-rae
  ☆32Updated last year
• HeegyuKim / language-model
  한국어 언어 모델 학습을 위한 프로젝트(Flax, Pytorch with Huggingface Accelerate)
  ☆32Updated last year
• HeegyuKim / ko-rm-judge
  Reward Model을 이용하여 언어모델의 답변을 평가하기
  ☆27Updated last year
• hkjeon13 / noising-korean
  한국어 문서에 노이즈를 추가합니다.
  ☆27Updated 2 years ago
• kakaoenterprise / KorAdvMRSTestData
  Adversarial Test Dataset for Korean Multi-turn Response Selection
  ☆34Updated 3 years ago
• wisenut-research / KoT5
  한국어 T5 모델
  ☆50Updated 3 years ago
• lih0905 / WSD_kor
  한국어 어휘 의미 분석 모델
  ☆20Updated 2 years ago
• haven-jeon / KoGPT2-subtasks
  NSMC, KorSTS ... fine-tunings
  ☆20Updated 3 years ago
• Beomi / easy-lm-trainer
  🤗 최소한의 세팅으로 LM을 학습하기 위한 샘플코드
  ☆58Updated last year
• korean-named-entity / konne-prep
  ☆19Updated 2 years ago
• ssu-humane / K-HATERS
  Hate speech detection corpus in Korean, shared with EMNLP 2023 paper
  ☆14Updated 11 months ago
• sb-jang / kodialogbench
  Code and data for "KoDialogBench: Evaluating Conversational Understanding of Language Models with Korean Dialogue Benchmark" (LREC-COLING…
  ☆15Updated last year
• jooinjang / Ko-ATOMIC
  Korean Commonsense Knowledge Graph
  ☆14Updated 2 years ago
• korean-named-entity / konne
  Korean Nested Named Entity Corpus
  ☆18Updated last year
• jeongukjae / korean-wikipedia-corpus
  문장단위로 분절된 한국어 위키피디아 코퍼스. Releases에서 다운로드 받거나 tfds-korean으로 사용해주세요.
  ☆24Updated last year
• BM-K / KoDiffCSE
  Difference-based Contrastive Learning for Korean Sentence Embeddings
  ☆24Updated last year
• LostCow / KLUE
  KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)
  ☆25Updated 2 years ago
• MrBananaHuman / open-korean-instructions
  언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.
  ☆19Updated last year
• seujung / t5-summarization
  ☆26Updated 4 years ago
• korean-named-entity / konec
  Korean Named Entity Corpus
  ☆25Updated last year
• soeque1 / KoGPT2-DINO
  ☆20Updated 2 years ago