Alternatives and similar repositories for polyglot-data:

Users that are interested in polyglot-data are comparing it to the libraries listed below

• jason9693 / polyglot-finetuning-oslo
  ☆19Updated 2 years ago
• hyunwoongko / beyond-lm
  Beyond LM: How can language model go forward in the future?
  ☆15Updated last year
• MrBananaHuman / open-korean-instructions
  언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.
  ☆19Updated last year
• EleutherAI / hae-rae
  ☆32Updated last year
• monologg / ko_lm_dataformat
  A utility for storing and reading files for Korean LM training 💾
  ☆36Updated last year
• BM-K / KoDiffCSE
  Difference-based Contrastive Learning for Korean Sentence Embeddings
  ☆24Updated last year
• ssu-humane / K-HATERS
  Hate speech detection corpus in Korean, shared with EMNLP 2023 paper
  ☆15Updated 11 months ago
• seujung / t5-summarization
  ☆26Updated 4 years ago
• HeegyuKim / korouge
  Google 공식 Rouge Implementation을 한국어에서 사용할 수 있도록 처리
  ☆14Updated last year
• jason9693 / oslo-kogpt-finetunig
  kogpt를 oslo로 파인튜닝하는 예제.
  ☆23Updated 2 years ago
• korean-named-entity / konec
  Korean Named Entity Corpus
  ☆25Updated last year
• haven-jeon / KoGPT2-subtasks
  NSMC, KorSTS ... fine-tunings
  ☆19Updated 3 years ago
• kakaoenterprise / KorAdvMRSTestData
  Adversarial Test Dataset for Korean Multi-turn Response Selection
  ☆34Updated 3 years ago
• hkjeon13 / noising-korean
  한국어 문서에 노이즈를 추가합니다.
  ☆27Updated 2 years ago
• J-Seo / Korean-CommonGen
  [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation
  ☆27Updated 2 years ago
• korean-named-entity / konne
  Korean Nested Named Entity Corpus
  ☆18Updated last year
• MrBananaHuman / UnethicalQuestionsKor
  ☆20Updated last year
• seujung / kolang-t5-base
  T5-base model for Korean
  ☆26Updated 3 years ago
• LostCow / KLUE
  KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)
  ☆25Updated 3 years ago
• MrBananaHuman / KoGPT2ForParaphrasing
  TEMP
  ☆34Updated 5 years ago
• MrBananaHuman / PangyoCorpora
  ☆34Updated last year
• lovit / kowikitext
  ☆19Updated 4 years ago
• simonjisu / annotated-transformer-kr
  annotated-transformer-kr
  ☆15Updated 5 years ago
• EleutherAI / dps
  Data processing system for polyglot
  ☆91Updated last year
• hyunwoongko / megatron-11b
  Megatron LM 11B on Huggingface Transformers
  ☆27Updated 3 years ago
• rladmstn1714 / CLIcK
  CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Korean
  ☆45Updated 3 months ago
• AIRC-KETI / Korean-Copora
  ☆14Updated 3 years ago
• naver-ai / carecall-corpus
  CareCall for Seniors: Role Specified Open-Domain Dialogue dataset generated by leveraging LLMs (NAACL 2022).
  ☆59Updated 2 years ago
• tunib-ai / artwork_captions
  Machine Generated Captions for Best Artworks
  ☆22Updated 2 years ago
• snunlp / KR-ELECTRA
  KoRean based ELECTRA pre-trained models (KR-ELECTRA) for Tensorflow and PyTorch
  ☆14Updated 3 years ago