Alternatives and similar repositories for DeepSpeedExamples:

Users that are interested in DeepSpeedExamples are comparing it to the libraries listed below

• deepspeedai / DeepSpeed
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
  ☆37,533Updated this week
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,322Updated 9 months ago
• THUDM / GLM-130B
  GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)
  ☆7,676Updated last year
• Instruction-Tuning-with-GPT-4 / GPT-4-LLM
  Instruction Tuning with GPT-4
  ☆4,284Updated last year
• OptimalScale / LMFlow
  An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
  ☆8,384Updated this week
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆17,837Updated this week
• NVIDIA / Megatron-LM
  Ongoing research training transformer models at scale
  ☆11,837Updated this week
• NVIDIA / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆6,089Updated 11 months ago
• CarperAI / trlx
  A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
  ☆4,603Updated last year
• BlinkDL / RWKV-LM
  RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…
  ☆13,409Updated this week
• Dao-AILab / flash-attention
  Fast and memory-efficient exact attention
  ☆16,462Updated this week
• deepspeedai / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆2,022Updated last month
• microsoft / LoRA
  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
  ☆11,573Updated 3 months ago
• baichuan-inc / Baichuan-7B
  A large-scale 7B pretraining language model developed by BaiChuan-Inc.
  ☆5,692Updated 8 months ago
• Facico / Chinese-Vicuna
  Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca
  ☆4,151Updated 4 months ago
• yizhongw / self-instruct
  Aligning pretrained language models with instruction data generated by themselves.
  ☆4,314Updated last year
• THUDM / GLM
  GLM (General Language Model)
  ☆3,227Updated last year
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆12,719Updated this week
• OpenGVLab / LLaMA-Adapter
  [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
  ☆5,838Updated last year
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆6,836Updated this week
• baichuan-inc / Baichuan2
  A series of large language models developed by Baichuan Intelligent Technology
  ☆4,128Updated 4 months ago
• Lightning-AI / lit-llama
  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…
  ☆6,043Updated 6 months ago
• FreedomIntelligence / LLMZoo
  ⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡
  ☆2,936Updated last year
• OpenMOSS / MOSS
  An open-source tool-augmented conversational language model from Fudan University
  ☆12,032Updated 8 months ago
• AutoGPTQ / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆4,766Updated last week
• mlfoundations / open_flamingo
  An open-source framework for training large multimodal models.
  ☆3,857Updated 6 months ago
• THUDM / VisualGLM-6B
  Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型
  ☆4,144Updated 7 months ago
• baichuan-inc / Baichuan-13B
  A 13B large language model developed by Baichuan Intelligent Technology
  ☆2,979Updated last year
• Vision-CAIR / MiniGPT-4
  Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
  ☆25,616Updated 6 months ago
• togethercomputer / RedPajama-Data
  The RedPajama-Data repository contains code for preparing large datasets for training large language models.
  ☆4,684Updated 3 months ago