pacman100 / accelerate-deepspeed-test
Testing DeepSpeed integration in ๐ค Accelerate
โ11Updated 2 years ago
Alternatives and similar repositories for accelerate-deepspeed-test:
Users that are interested in accelerate-deepspeed-test are comparing it to the libraries listed below
- This hands-on lab aims to alleviate some of that headache by demonstrating how to create/augment a QnA dataset from complex unstructured โฆโ45Updated 5 months ago
- โ19Updated 9 months ago
- An unofficial implementation of SOLAR-10.7B model and the newly proposed interlocked-DUS(iDUS) implementation and experiment details.โ12Updated last year
- [NAACL 2024] Official repository for "KTRL+F: Knowledge-Augmented In-Document Search"โ23Updated 6 months ago
- Difference-based Contrastive Learning for Korean Sentence Embeddingsโ24Updated last year
- Sakura-SOLAR-DPO: Merge, SFT, and DPOโ117Updated last year
- [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervisionโ87Updated 5 months ago
- [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messagesโ45Updated 4 months ago
- Train ๐คtransformers with DeepSpeed: ZeRO-2, ZeRO-3โ23Updated 3 years ago
- โ17Updated 11 months ago
- ์ธ์ด๋ชจ๋ธ์ ํ์ตํ๊ธฐ ์ํ ๊ณต๊ฐ ํ๊ตญ์ด instruction dataset๋ค์ ๋ชจ์๋์์ต๋๋ค.โ19Updated last year
- evolve llm training instruction, from english instruction to any language.โ115Updated last year
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Modelsโ25Updated 8 months ago
- โ10Updated 7 months ago
- Calculating Expected Time for training LLM.โ38Updated 2 years ago
- โ35Updated last year
- Reward Model์ ์ด์ฉํ์ฌ ์ธ์ด๋ชจ๋ธ์ ๋ต๋ณ์ ํ๊ฐํ๊ธฐโ27Updated last year
- BERT score for text generationโ11Updated 3 months ago
- Alpaca-lora for huggingface implementation using Deepspeed and FullyShardedDataParallelโ24Updated 2 years ago
- โ32Updated last year
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuningโ90Updated last year
- KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)โ25Updated 3 years ago
- Implementation of stop sequencer for Huggingface Transformersโ16Updated last year
- A Framework aims to wisely initialize unseen subword embeddings in PLMs for efficient large-scale continued pretrainingโ16Updated last year
- An extended project of the LLM Compiler paper, focusing on developing LLM-based Autonomous Agents.โ23Updated 6 months ago
- Don't Judge a Language Model by Its Last Layer: Contrastive Learning with Layer-Wise Attention Poolingโ9Updated 2 years ago
- 1-Click is all you need.โ61Updated last year
- Ensembling Hugging Face transformers made easyโ62Updated 2 years ago
- [ACL 2023] Few-shot Reranking for Multi-hop QA via Language Model Promptingโ27Updated last year
- For the rlhf learning environment of Koreansโ23Updated last year