pacman100 / accelerate-deepspeed-testLinks
Testing DeepSpeed integration in π€ Accelerate
β11Updated 2 years ago
Alternatives and similar repositories for accelerate-deepspeed-test
Users that are interested in accelerate-deepspeed-test are comparing it to the libraries listed below
Sorting:
- An unofficial implementation of SOLAR-10.7B model and the newly proposed interlocked-DUS(iDUS) implementation and experiment details.β12Updated last year
- β17Updated last year
- This hands-on lab aims to alleviate some of that headache by demonstrating how to create/augment a QnA dataset from complex unstructured β¦β49Updated last month
- [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervisionβ89Updated 7 months ago
- Alpaca-lora for huggingface implementation using Deepspeed and FullyShardedDataParallelβ24Updated 2 years ago
- evolve llm training instruction, from english instruction to any language.β117Updated last year
- [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messagesβ47Updated 6 months ago
- This is the code for our paper: PLACES: Prompting Language Models for Social Conversation Synthesisβ11Updated 2 years ago
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuningβ89Updated last year
- Sakura-SOLAR-DPO: Merge, SFT, and DPOβ116Updated last year
- [NAACL 2024] Official repository for "KTRL+F: Knowledge-Augmented In-Document Search"β23Updated 7 months ago
- Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"β42Updated 6 months ago
- Train π€transformers with DeepSpeed: ZeRO-2, ZeRO-3β23Updated 4 years ago
- [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"β33Updated 5 months ago
- Continue Pretraining T5 on custom dataset based on available pretrained model checkpointsβ38Updated 4 years ago
- PyTorch reimplementation of the paper "SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarization"β16Updated 3 years ago
- [NAACL 2022] Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learning.β57Updated last year
- [ACL 2023] Few-shot Reranking for Multi-hop QA via Language Model Promptingβ27Updated 2 years ago
- β19Updated 10 months ago
- [EACL 2023] CoTEVer: Chain of Thought Prompting Annotation Toolkit for Explanation Verificationβ41Updated 2 years ago
- [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Followingβ79Updated 8 months ago
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with Lβ¦β43Updated last year
- Tool for converting LLMs from uni-directional to bi-directional by removing causal mask for tasks like classification and sentence embeddβ¦β59Updated 5 months ago
- β20Updated 3 years ago
- This repository contains the joint use of CPO and SimPO method for better reference-free preference learning methods.β53Updated 9 months ago
- β33Updated 2 months ago
- A Multilingual Replicable Instruction-Following Modelβ93Updated last year
- Ensembling Hugging Face transformers made easyβ63Updated 2 years ago
- Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)β29Updated last year
- Calculating Expected Time for training LLM.β38Updated 2 years ago