deepspeedai / DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
☆37,431Updated this week
Alternatives and similar repositories for DeepSpeed:
Users that are interested in DeepSpeed are comparing it to the libraries listed below
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆38,132Updated 2 weeks ago
- Example models using DeepSpeed☆6,362Updated this week
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆29,871Updated 8 months ago
- Inference code for Llama models☆57,876Updated last month
- Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)☆25,606Updated 6 months ago
- Making large AI models cheaper, faster and more accessible☆40,618Updated this week
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆13,374Updated this week
- Instruct-tune LLaMA on consumer hardware☆18,836Updated 7 months ago
- Ongoing research training transformer models at scale☆11,759Updated this week
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆17,795Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆41,815Updated this week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆40,106Updated this week
- Running large language models on a single GPU for throughput-oriented scenarios.☆9,275Updated 4 months ago
- Universal LLM Deployment Engine with ML Compilation☆20,198Updated this week
- JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf☆24,012Updated 5 months ago
- Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"☆11,500Updated 3 months ago
- Fast and memory-efficient exact attention☆16,370Updated this week
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,303Updated 9 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆40,117Updated 3 months ago
- Train transformer language models with reinforcement learning.☆12,591Updated this week
- Inference Llama 2 in one file of pure C☆18,170Updated 7 months ago
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆20,914Updated 2 weeks ago
- GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)☆7,681Updated last year
- 🦜🔗 Build context-aware reasoning applications☆103,389Updated this week
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆21,566Updated 7 months ago
- StableLM: Stability AI Language Models☆15,836Updated 11 months ago
- Transformer related optimization, including BERT, GPT☆6,084Updated 11 months ago
- An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.☆8,375Updated this week
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆72,834Updated 3 weeks ago
- Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!☆36,801Updated this week