hyunwoongko / megatron-11b
Megatron LM 11B on Huggingface Transformers
☆27Updated 3 years ago
Alternatives and similar repositories for megatron-11b:
Users that are interested in megatron-11b are comparing it to the libraries listed below
- Implementation of stop sequencer for Huggingface Transformers☆16Updated last year
- 언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.☆19Updated last year
- Abstractive summarization using Bert2Bert framework.☆31Updated 4 years ago
- baikal.ai's pre-trained BERT models: descriptions and sample codes☆12Updated 3 years ago
- KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)☆25Updated 2 years ago
- Difference-based Contrastive Learning for Korean Sentence Embeddings☆24Updated last year
- This is project for korean auto spacing☆12Updated 4 years ago
- Korean Named Entity Corpus☆25Updated last year
- Beyond LM: How can language model go forward in the future?☆15Updated last year
- 매주 목요일, 20:00 모임☆16Updated 4 years ago
- ☆26Updated 4 years ago
- Hate speech detection corpus in Korean, shared with EMNLP 2023 paper☆13Updated 9 months ago
- Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3☆23Updated 3 years ago
- 2019 국어경진대회 한국어 의존구문 분석 대상(문체부 장관상)☆16Updated 2 years ago
- Adversarial Test Dataset for Korean Multi-turn Response Selection☆34Updated 3 years ago
- 모두의 말뭉치 데이터를 분석에 편리한 형태로 변환하는 기능을 제공합니다.☆11Updated 2 years ago
- 한국어 문서에 노이즈를 추가합니다.☆27Updated 2 years ago
- This repository forked from parlAI. Korean Wizard of Wikipedia task was added to this repo. This repository is going to be moved after EM…☆16Updated 2 years ago
- TEMP☆34Updated 4 years ago
- Script to pre-train hugginface transformers BART with Tensorflow 2☆33Updated last year
- [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation☆12Updated 2 years ago
- MeCab model trained with OpenKorPos.☆22Updated 2 years ago
- A PyTorch Implementation of the Luna: Linear Unified Nested Attention☆41Updated 3 years ago
- Pytorch Implementation of EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks☆63Updated 2 years ago
- kogpt를 oslo로 파인튜닝하는 예제.☆23Updated 2 years ago