Alternatives and similar repositories for transformers-language-modeling

Users that are interested in transformers-language-modeling are comparing it to the libraries listed below

• hyunwoongko / megatron-11b
  Megatron LM 11B on Huggingface Transformers
  ☆27Updated 3 years ago
• hyunwoongko / bert2bert-summarization
  Abstractive summarization using Bert2Bert framework.
  ☆31Updated 4 years ago
• LostCow / KLUE
  KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)
  ☆25Updated 3 years ago
• MrBananaHuman / open-korean-instructions
  언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.
  ☆19Updated last year
• BM-K / KoDiffCSE
  Difference-based Contrastive Learning for Korean Sentence Embeddings
  ☆24Updated 2 years ago
• nlpai-lab / Korean-CommonGen
  [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation
  ☆12Updated 3 years ago
• HeegyuKim / korouge
  Google 공식 Rouge Implementation을 한국어에서 사용할 수 있도록 처리
  ☆15Updated last year
• hyunwoongko / beyond-lm
  Beyond LM: How can language model go forward in the future?
  ☆15Updated 2 years ago
• jason9693 / ETA4LLMs
  Calculating Expected Time for training LLM.
  ☆38Updated 2 years ago
• ko-nlp / moducorpus-sanitizer
  모두의 말뭉치 데이터를 분석에 편리한 형태로 변환하는 기능을 제공합니다.
  ☆11Updated 3 years ago
• baikalai / baikal-bert
  baikal.ai's pre-trained BERT models: descriptions and sample codes
  ☆12Updated 4 years ago
• nlpods / LayerAttPooler
  Don't Judge a Language Model by Its Last Layer: Contrastive Learning with Layer-Wise Attention Pooling
  ☆9Updated 2 years ago
• seujung / t5-summarization
  ☆26Updated 4 years ago
• hanjanghoon / NLP_Koeran_DP
  2019 국어경진대회 한국어 의존구문 분석 대상(문체부 장관상)
  ☆16Updated 2 years ago
• korean-named-entity / konec
  Korean Named Entity Corpus
  ☆25Updated 2 years ago
• ssu-humane / K-HATERS
  Hate speech detection corpus in Korean, shared with EMNLP 2023 paper
  ☆15Updated last year
• cosmoquester / transformers-bart-pretrain
  Script to pre-train hugginface transformers BART with Tensorflow 2
  ☆33Updated 2 years ago
• AIRC-KETI / kowow
  This repository forked from parlAI. Korean Wizard of Wikipedia task was added to this repo. This repository is going to be moved after EM…
  ☆16Updated 2 years ago
• tunib-ai / artwork_captions
  Machine Generated Captions for Best Artworks
  ☆22Updated 2 years ago
• teddysum / Korean_SC_2023
  ☆10Updated 7 months ago
• JoungheeKim / kor-spacing
  This is project for korean auto spacing
  ☆12Updated 4 years ago
• choe-hyonsu-gabrielle / korean-amr-corpus
  Korean Abstract Meaning Representation (AMR) Corpus
  ☆10Updated 3 years ago
• hkjeon13 / noising-korean
  한국어 문서에 노이즈를 추가합니다.
  ☆27Updated 2 years ago
• jooinjang / Ko-ATOMIC
  Korean Commonsense Knowledge Graph
  ☆14Updated 2 years ago
• korean-named-entity / konne
  Korean Nested Named Entity Corpus
  ☆18Updated 2 years ago
• AIRC-KETI / Korean-Copora
  ☆14Updated 3 years ago
• QuoQA-NLP / Ko-conceptual-captions
  Google's Conceptual Captions Dataset translated into Korean
  ☆22Updated 2 years ago
• Marker-Inc-Korea / OpenFlaminKO
  Polyglot을 활용한 image-text multimodal
  ☆11Updated last year
• robinsongh381 / UNILM_Pytorch_Korean
  ☆11Updated 4 years ago
• morganmcg1 / rotobart
  Pre-training BART in Flax on The Pile dataset
  ☆21Updated 3 years ago