Alternatives and similar repositories for DeepSpeedExamples:

Users that are interested in DeepSpeedExamples are comparing it to the libraries listed below

• deepspeedai / DeepSpeed
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
  ☆37,834Updated this week
• Instruction-Tuning-with-GPT-4 / GPT-4-LLM
  Instruction Tuning with GPT-4
  ☆4,297Updated last year
• OptimalScale / LMFlow
  An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
  ☆8,398Updated this week
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,366Updated 10 months ago
• THUDM / GLM-130B
  GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)
  ☆7,678Updated last year
• deepspeedai / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆2,042Updated 3 weeks ago
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆18,082Updated this week
• THUDM / GLM
  GLM (General Language Model)
  ☆3,230Updated last year
• project-baize / baize-chatbot
  Let ChatGPT teach your own chatbot in hours with a single GPU!
  ☆3,168Updated last year
• NVIDIA / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆6,116Updated last year
• AutoGPTQ / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆4,802Updated 3 weeks ago
• FreedomIntelligence / LLMZoo
  ⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡
  ☆2,943Updated last year
• togethercomputer / RedPajama-Data
  The RedPajama-Data repository contains code for preparing large datasets for training large language models.
  ☆4,696Updated 4 months ago
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆6,918Updated this week
• CarperAI / trlx
  A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
  ☆4,621Updated last year
• microsoft / LoRA
  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
  ☆11,730Updated 3 months ago
• PhoebusSi / Alpaca-CoT
  We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tunin…
  ☆2,728Updated last year
• BlinkDL / RWKV-LM
  RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…
  ☆13,504Updated last week
• OpenGVLab / LLaMA-Adapter
  [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
  ☆5,856Updated last year
• Facico / Chinese-Vicuna
  Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca
  ☆4,153Updated 5 months ago
• NVIDIA / Megatron-LM
  Ongoing research training transformer models at scale
  ☆12,032Updated this week
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆6,848Updated 9 months ago
• yizhongw / self-instruct
  Aligning pretrained language models with instruction data generated by themselves.
  ☆4,340Updated 2 years ago
• baichuan-inc / Baichuan-7B
  A large-scale 7B pretraining language model developed by BaiChuan-Inc.
  ☆5,691Updated 8 months ago
• LianjiaTech / BELLE
  BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）
  ☆8,115Updated 5 months ago
• BlinkDL / ChatRWKV
  ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
  ☆9,471Updated 2 months ago
• FMInference / FlexLLMGen
  Running large language models on a single GPU for throughput-oriented scenarios.
  ☆9,297Updated 5 months ago
• facebookresearch / xformers
  Hackable and optimized Transformers building blocks, supporting a composable construction.
  ☆9,319Updated this week
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,889Updated 8 months ago
• AetherCortex / Llama-X
  Open Academic Research on Improving LLaMA to SOTA LLM
  ☆1,619Updated last year