Alternatives and similar repositories for DeepSpeedExamples

Users that are interested in DeepSpeedExamples are comparing it to the libraries listed below

• OptimalScale / LMFlow
  An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
  ☆8,435Updated last month
• deepspeedai / DeepSpeed
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
  ☆39,142Updated this week
• THUDM / GLM-130B
  GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)
  ☆7,682Updated last year
• THUDM / GLM
  GLM (General Language Model)
  ☆3,240Updated last year
• yizhongw / self-instruct
  Aligning pretrained language models with instruction data generated by themselves.
  ☆4,404Updated 2 years ago
• Instruction-Tuning-with-GPT-4 / GPT-4-LLM
  Instruction Tuning with GPT-4
  ☆4,309Updated 2 years ago
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,518Updated last year
• OpenGVLab / LLaMA-Adapter
  [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
  ☆5,886Updated last year
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆7,167Updated this week
• LianjiaTech / BELLE
  BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）
  ☆8,176Updated 8 months ago
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆18,861Updated this week
• microsoft / LoRA
  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
  ☆12,153Updated 6 months ago
• baichuan-inc / Baichuan-7B
  A large-scale 7B pretraining language model developed by BaiChuan-Inc.
  ☆5,687Updated 11 months ago
• Lightning-AI / lit-llama
  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…
  ☆6,073Updated 9 months ago
• modelscope / modelscope
  ModelScope: bring the notion of Model-as-a-Service to life.
  ☆8,032Updated this week
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆14,366Updated this week
• Facico / Chinese-Vicuna
  Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca
  ☆4,153Updated 2 months ago
• baichuan-inc / Baichuan2
  A series of large language models developed by Baichuan Intelligent Technology
  ☆4,125Updated 7 months ago
• CarperAI / trlx
  A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
  ☆4,674Updated last year
• NVIDIA / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆6,219Updated last year
• FlagAI-Open / FlagAI
  FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.
  ☆3,875Updated 6 months ago
• PhoebusSi / Alpaca-CoT
  We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tunin…
  ☆2,750Updated last year
• FreedomIntelligence / LLMZoo
  ⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡
  ☆2,944Updated last year
• THUDM / P-tuning-v2
  An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
  ☆2,044Updated last year
• facebookresearch / xformers
  Hackable and optimized Transformers building blocks, supporting a composable construction.
  ☆9,641Updated this week
• Dao-AILab / flash-attention
  Fast and memory-efficient exact attention
  ☆18,043Updated this week
• deepspeedai / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆2,096Updated 3 months ago
• mlfoundations / open_flamingo
  An open-source framework for training large multimodal models.
  ☆3,960Updated 10 months ago
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,927Updated 11 months ago
• CVI-SZU / Linly
  Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集
  ☆3,053Updated last year