pacman100 / accelerate-deepspeed-testLinks
Testing DeepSpeed integration in 🤗 Accelerate
☆11Updated 3 years ago
Alternatives and similar repositories for accelerate-deepspeed-test
Users that are interested in accelerate-deepspeed-test are comparing it to the libraries listed below
Sorting:
- evolve llm training instruction, from english instruction to any language.☆119Updated 2 years ago
- Sakura-SOLAR-DPO: Merge, SFT, and DPO☆116Updated 2 years ago
- [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision☆95Updated last year
- This hands-on lab aims to alleviate some of that headache by demonstrating how to create/augment a QnA dataset from complex unstructured …☆64Updated 9 months ago
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆95Updated 2 years ago
- An unofficial implementation of SOLAR-10.7B model and the newly proposed interlocked-DUS(iDUS) implementation and experiment details.☆14Updated last year
- Alpaca-lora for huggingface implementation using Deepspeed and FullyShardedDataParallel☆24Updated 2 years ago
- [NAACL 2024] Official repository for "KTRL+F: Knowledge-Augmented In-Document Search"☆23Updated last year
- ☆16Updated last year
- This is the code for our paper: PLACES: Prompting Language Models for Social Conversation Synthesis☆11Updated 2 years ago
- Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3☆23Updated 4 years ago
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆96Updated 2 years ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆77Updated last year
- ☆130Updated last year
- [ACL 2025 Main] Official Repository for "Evaluating Language Models as Synthetic Data Generators"☆40Updated last year
- Implementation of stop sequencer for Huggingface Transformers☆16Updated 2 years ago
- ☆32Updated 2 years ago
- Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"☆54Updated last year
- ☆20Updated last year
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆254Updated 2 years ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆144Updated 2 years ago
- [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following☆79Updated last year
- Difference-based Contrastive Learning for Korean Sentence Embeddings☆24Updated 2 years ago
- This repository provides the code for applying Contrastive Learning Penalty Loss (CLPL) and Mixture of Experts (MoE) to the BGE-M3 text e…☆11Updated last year
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Models☆25Updated last year
- Observe the slow deterioration of my mental sanity in the github commit history☆12Updated 2 years ago
- [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages☆53Updated 6 months ago
- A hackable, simple, and reseach-friendly GRPO Training Framework with high speed weight synchronization in a multinode environment.☆36Updated 5 months ago
- Open-WikiTable :Dataset for Open Domain Question Answering with Complex Reasoning over Table☆27Updated 2 years ago
- Convert pretrained RoBerta models to various long-document transformer models☆11Updated 3 years ago