pacman100 / accelerate-deepspeed-testLinks
Testing DeepSpeed integration in π€ Accelerate
β11Updated 3 years ago
Alternatives and similar repositories for accelerate-deepspeed-test
Users that are interested in accelerate-deepspeed-test are comparing it to the libraries listed below
Sorting:
- This hands-on lab aims to alleviate some of that headache by demonstrating how to create/augment a QnA dataset from complex unstructured β¦β55Updated 4 months ago
- Sakura-SOLAR-DPO: Merge, SFT, and DPOβ116Updated last year
- evolve llm training instruction, from english instruction to any language.β119Updated 2 years ago
- [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervisionβ92Updated 10 months ago
- An unofficial implementation of SOLAR-10.7B model and the newly proposed interlocked-DUS(iDUS) implementation and experiment details.β13Updated last year
- Alpaca-lora for huggingface implementation using Deepspeed and FullyShardedDataParallelβ24Updated 2 years ago
- β17Updated last year
- [NAACL 2024] Official repository for "KTRL+F: Knowledge-Augmented In-Document Search"β23Updated 11 months ago
- A hackable, simple, and reseach-friendly GRPO Training Framework with high speed weight synchronization in a multinode environment.β31Updated 3 weeks ago
- β20Updated last year
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuningβ94Updated 2 years ago
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Modelsβ25Updated last year
- β31Updated 2 years ago
- An extended project of the LLM Compiler paper, focusing on developing LLM-based Autonomous Agents.β26Updated 11 months ago
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuningβ247Updated last year
- [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Followingβ78Updated last year
- [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messagesβ49Updated last month
- Implementation of stop sequencer for Huggingface Transformersβ16Updated 2 years ago
- β11Updated last week
- This is the code for our paper: PLACES: Prompting Language Models for Social Conversation Synthesisβ11Updated 2 years ago
- β127Updated 11 months ago
- [ACL 2025 Main] Official Repository for "Evaluating Language Models as Synthetic Data Generators"β38Updated 9 months ago
- Train π€transformers with DeepSpeed: ZeRO-2, ZeRO-3β23Updated 4 years ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.β138Updated 2 years ago
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with Lβ¦β45Updated 2 years ago
- The git repository of Modular Prompted Chatbot paperβ35Updated 2 years ago
- Difference-based Contrastive Learning for Korean Sentence Embeddingsβ25Updated 2 years ago
- Official implementation of "OffsetBias: Leveraging Debiased Data for Tuning Evaluators"β25Updated last year
- Benchmarking library for RAGβ227Updated 2 months ago
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedbackβ97Updated 2 years ago