Alternatives and similar repositories for accelerate-deepspeed-test

Users that are interested in accelerate-deepspeed-test are comparing it to the libraries listed below

• gauss5930 / iDUS
  An unofficial implementation of SOLAR-10.7B model and the newly proposed interlocked-DUS(iDUS) implementation and experiment details.
  ☆12Updated last year
• hills-code / open-instruct
  ☆17Updated last year
• Azure / synthetic-qa-generation
  This hands-on lab aims to alleviate some of that headache by demonstrating how to create/augment a QnA dataset from complex unstructured …
  ☆49Updated last month
• kaistAI / LangBridge
  [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision
  ☆89Updated 7 months ago
• gigio1023 / alpaca-lora-for-huggingface
  Alpaca-lora for huggingface implementation using Deepspeed and FullyShardedDataParallel
  ☆24Updated 2 years ago
• lcw99 / evolve-instruct
  evolve llm training instruction, from english instruction to any language.
  ☆117Updated last year
• kaistAI / Janus
  [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages
  ☆47Updated 6 months ago
• alexa / places
  This is the code for our paper: PLACES: Prompting Language Models for Social Conversation Synthesis
  ☆11Updated 2 years ago
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆89Updated last year
• KyujinHan / Sakura-SOLAR-DPO
  Sakura-SOLAR-DPO: Merge, SFT, and DPO
  ☆116Updated last year
• kaistAI / KtrlF
  [NAACL 2024] Official repository for "KTRL+F: Knowledge-Augmented In-Document Search"
  ☆23Updated 7 months ago
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆42Updated 6 months ago
• Beomi / transformers-language-modeling
  Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3
  ☆23Updated 4 years ago
• neulab / data-agora
  [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"
  ☆33Updated 5 months ago
• joeljang / Pretraining_T5_custom_dataset
  Continue Pretraining T5 on custom dataset based on available pretrained model checkpoints
  ☆38Updated 4 years ago
• andrejmiscic / simcls-pytorch
  PyTorch reimplementation of the paper "SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarization"
  ☆16Updated 3 years ago
• luka-group / Lattice
  [NAACL 2022] Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learning.
  ☆57Updated last year
• mukhal / PromptRank
  [ACL 2023] Few-shot Reranking for Multi-hop QA via Language Model Prompting
  ☆27Updated 2 years ago
• wandb / llm-kr-eval
  ☆19Updated 10 months ago
• SeungoneKim / CoTEVer
  [EACL 2023] CoTEVer: Chain of Thought Prompting Annotation Toolkit for Explanation Verification
  ☆41Updated 2 years ago
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆79Updated 8 months ago
• soochan-lee / RoT
  Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…
  ☆43Updated last year
• WhereIsAI / BiLLM
  Tool for converting LLMs from uni-directional to bi-directional by removing causal mask for tasks like classification and sentence embedd…
  ☆59Updated 5 months ago
• Zefty / rag-end2end-retriever
  ☆20Updated 3 years ago
• fe1ixxu / CPO_SIMPO
  This repository contains the joint use of CPO and SimPO method for better reference-free preference learning methods.
  ☆53Updated 9 months ago
• Silin159 / PeaCoK
  ☆33Updated 2 months ago
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆93Updated last year
• jaketae / ensemble-transformers
  Ensembling Hugging Face transformers made easy
  ☆63Updated 2 years ago
• thomasgauthier / LLM-self-play
  Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)
  ☆29Updated last year
• jason9693 / ETA4LLMs
  Calculating Expected Time for training LLM.
  ☆38Updated 2 years ago