hyunwoongko / stop-sequencer
Implementation of stop sequencer for Huggingface Transformers
☆16Updated last year
Alternatives and similar repositories for stop-sequencer:
Users that are interested in stop-sequencer are comparing it to the libraries listed below
- Difference-based Contrastive Learning for Korean Sentence Embeddings☆24Updated last year
- 언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.☆19Updated last year
- Megatron LM 11B on Huggingface Transformers☆27Updated 3 years ago
- Calculating Expected Time for training LLM.☆38Updated 2 years ago
- ☆23Updated last year
- [NAACL 2024] Official repository for "KTRL+F: Knowledge-Augmented In-Document Search"☆23Updated 6 months ago
- Hate speech detection corpus in Korean, shared with EMNLP 2023 paper☆15Updated last year
- Beyond LM: How can language model go forward in the future?☆15Updated last year
- Google's Conceptual Captions Dataset translated into Korean☆22Updated 2 years ago
- Google 공식 Rouge Implementation을 한국어에서 사용할 수 있도록 처리☆14Updated last year
- ☆32Updated last year
- ☆20Updated last year
- Deploy KoGPT with Triton Inference Server☆14Updated 2 years ago
- Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3☆23Updated 3 years ago
- Machine Generated Captions for Best Artworks☆22Updated 2 years ago
- Polyglot을 활용한 image-text multimodal☆11Updated last year
- StrategyQA 데이터 세트 번역☆22Updated last year
- MeCab model trained with OpenKorPos.☆23Updated 2 years ago
- NSMC, KorSTS ... fine-tunings☆19Updated 3 years ago
- [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation☆27Updated 2 years ago
- ☆20Updated last year
- A PyTorch Implementation of the Luna: Linear Unified Nested Attention☆41Updated 3 years ago
- KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)☆25Updated 3 years ago
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Models☆25Updated 8 months ago
- This repository forked from parlAI. Korean Wizard of Wikipedia task was added to this repo. This repository is going to be moved after EM…☆16Updated 2 years ago
- ☆19Updated 2 years ago
- ☆35Updated last year
- For the rlhf learning environment of Koreans☆23Updated last year
- ↔️ T5 Machine Translation from English to Korean☆18Updated 2 years ago
- evolve llm training instruction, from english instruction to any language.☆115Updated last year