Beomi / transformers-language-modeling
Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3
☆21Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for transformers-language-modeling
- 언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습 니다.☆19Updated last year
- Hate speech detection corpus in Korean, shared with EMNLP 2023 paper☆13Updated 6 months ago
- Abstractive summarization using Bert2Bert framework.☆31Updated 3 years ago
- KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)☆25Updated 2 years ago
- Beyond LM: How can language model go forward in the future?☆15Updated last year
- Difference-based Contrastive Learning for Korean Sentence Embeddings☆24Updated last year
- Megatron LM 11B on Huggingface Transformers☆27Updated 3 years ago
- Google 공식 Rouge Implementation을 한국어에서 사용할 수 있도록 처리☆13Updated 10 months ago
- Korean Named Entity Corpus☆24Updated last year
- Korean Nested Named Entity Corpus☆16Updated last year
- [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation☆12Updated 2 years ago
- Machine Generated Captions for Best Artworks☆22Updated 2 years ago
- Calculating Expected Time for training LLM.☆38Updated last year
- ☆14Updated 2 years ago
- Korean Abstract Meaning Representation (AMR) Corpus☆10Updated 2 years ago
- Official code and dataset repository of KoBBQ (TACL 2024)☆14Updated 5 months ago
- Script to pre-train hugginface transformers BART with Tensorflow 2☆34Updated last year
- 2019 국어경진대회 한국어 의존구문 분석 대상(문체부 장관상)☆16Updated 2 years ago
- 모두의 말뭉치 데이터를 분석에 편리한 형태로 변환하는 기능을 제공합니다.☆11Updated 2 years ago
- Implementation of stop sequencer for Huggingface Transformers☆15Updated last year
- ☆26Updated 4 years ago
- Pre-training BART in Flax on The Pile dataset☆20Updated 3 years ago
- ☆10Updated 2 weeks ago
- This repository forked from parlAI. Korean Wizard of Wikipedia task was added to this repo. This repository is going to be moved after EM…☆16Updated last year
- Polyglot을 활용한 image-text multimodal☆11Updated last year
- Korean Commonsense Knowledge Graph☆14Updated last year