huggingface / accelerate
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
☆7,911Updated this week
Related projects ⓘ
Alternatives and complementary repositories for accelerate
- Fast and memory-efficient exact attention☆14,109Updated this week
- Train transformer language models with reinforcement learning.☆9,967Updated this week
- Transformer related optimization, including BERT, GPT☆5,871Updated 7 months ago
- Accessible large language models via k-bit quantization for PyTorch.☆6,244Updated this week
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆16,354Updated this week
- Hackable and optimized Transformers building blocks, supporting a composable construction.☆8,612Updated this week
- PyTorch extensions for high performance and large scale training.☆3,187Updated 2 months ago
- Ongoing research training transformer models at scale☆10,480Updated this week
- A concise but complete full-attention transformer with a set of promising experimental features from various papers☆4,760Updated this week
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)☆8,500Updated 3 weeks ago
- An open source implementation of CLIP.☆10,234Updated this week
- 🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools☆2,556Updated this week
- Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"☆10,661Updated 2 months ago
- Pretrain, finetune ANY AI model of ANY size on multiple GPUs, TPUs with zero code changes.☆28,337Updated this week
- Foundation Architecture for (M)LLMs☆3,025Updated 6 months ago
- LAVIS - A One-stop Library for Language-Vision Intelligence☆9,898Updated 3 weeks ago
- A Unified Library for Parameter-Efficient and Modular Transfer Learning☆2,566Updated last week
- A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch☆8,392Updated last week
- A framework for few-shot evaluation of language models.☆6,904Updated this week
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.☆2,303Updated last month
- Serve, optimize and scale PyTorch models in production☆4,209Updated 2 weeks ago
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆20,122Updated last week
- A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆4,500Updated 10 months ago
- Machine learning metrics for distributed, scalable PyTorch applications.☆2,134Updated this week
- Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"☆6,160Updated last month
- BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)☆6,919Updated last year
- Unsupervised text tokenizer for Neural Network-based text generation.☆10,252Updated last week
- State-of-the-Art Text Embeddings☆15,236Updated this week
- An open-source framework for training large multimodal models.☆3,732Updated 2 months ago
- 🤗 Evaluate: A library for easily evaluating machine learning models and datasets.☆2,029Updated last month