jason9693 / ETA4LLMsLinks
Calculating Expected Time for training LLM.
☆38Updated 2 years ago
Alternatives and similar repositories for ETA4LLMs
Users that are interested in ETA4LLMs are comparing it to the libraries listed below
Sorting:
- Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3☆23Updated 4 years ago
- Difference-based Contrastive Learning for Korean Sentence Embeddings☆25Updated 2 years ago
- 언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.☆19Updated 2 years ago
- Beyond LM: How can language model go forward in the future?☆15Updated 2 years ago
- ☆19Updated 2 years ago
- Convenient Text-to-Text Training for Transformers☆19Updated 3 years ago
- KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)☆25Updated 3 years ago
- Google 공식 Rouge Implementation을 한국어에서 사용할 수 있도록 처리☆16Updated last year
- Implementation of stop sequencer for Huggingface Transformers☆16Updated 2 years ago
- Korean Nested Named Entity Corpus☆20Updated 2 years ago
- CareCall for Seniors: Role Specified Open-Domain Dialogue dataset generated by leveraging LLMs (NAACL 2022).☆60Updated 3 years ago
- [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation☆27Updated 2 years ago
- ☆14Updated 3 years ago
- exBERT on Transformers🤗☆10Updated 4 years ago
- "Why do I feel offended?" - Korean Dataset for Offensive Language Identification (EACL2023 Findings)☆15Updated 2 years ago
- ☆20Updated 2 years ago
- ☆30Updated last year
- ☆20Updated last year
- Megatron LM 11B on Huggingface Transformers☆27Updated 4 years ago
- ☆32Updated last year
- A Framework aims to wisely initialize unseen subword embeddings in PLMs for efficient large-scale continued pretraining☆18Updated last year
- Hate speech detection corpus in Korean, shared with EMNLP 2023 paper☆15Updated last year
- ☆23Updated last year
- Machine Generated Captions for Best Artworks☆22Updated 2 years ago
- A PyTorch Implementation of the Luna: Linear Unified Nested Attention☆41Updated 4 years ago
- For the rlhf learning environment of Koreans☆23Updated last year
- Implementation of autoregressive language model using improved Transformer and DeepSpeed pipeline parallelism.☆32Updated 3 years ago
- data related codebase for polyglot project☆19Updated 2 years ago
- KETOD Knowledge-Enriched Task-Oriented Dialogue☆32Updated 2 years ago
- [NAACL 2024] Official repository for "KTRL+F: Knowledge-Augmented In-Document Search"☆23Updated 9 months ago