microsoft / DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
☆35,508Updated this week
Related projects ⓘ
Alternatives and complementary repositories for DeepSpeed
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆29,561Updated 4 months ago
- Example models using DeepSpeed☆6,090Updated last week
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆16,471Updated this week
- Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"☆10,776Updated 3 months ago
- JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf☆23,718Updated last month
- RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…☆12,672Updated this week
- Making large AI models cheaper, faster and more accessible☆38,821Updated this week
- Fast and memory-efficient exact attention☆14,279Updated this week
- Instruct-tune LLaMA on consumer hardware☆18,653Updated 3 months ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆36,993Updated this week
- Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)☆25,430Updated 2 months ago
- GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)☆7,657Updated last year
- Ongoing research training transformer models at scale☆10,595Updated this week
- 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…☆7,958Updated this week
- 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.☆135,166Updated this week
- Running large language models on a single GPU for throughput-oriented scenarios.☆9,198Updated 3 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆30,423Updated this week
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆20,194Updated last week
- Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!☆34,030Updated this week
- OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamical…☆37,071Updated 3 months ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,059Updated 5 months ago
- Inference code for Llama models☆56,450Updated 3 months ago
- StableLM: Stability AI Language Models☆15,828Updated 7 months ago
- Train transformer language models with reinforcement learning.☆10,086Updated this week
- An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.☆8,276Updated this week
- 🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.☆26,242Updated this week
- 中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)☆18,407Updated 6 months ago
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆20,199Updated 3 months ago
- 🦜🔗 Build context-aware reasoning applications☆95,070Updated this week