facebookresearch / xformers
Hackable and optimized Transformers building blocks, supporting a composable construction.
☆8,660Updated this week
Related projects ⓘ
Alternatives and complementary repositories for xformers
- Fast and memory-efficient exact attention☆14,279Updated this week
- 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…☆7,958Updated this week
- Accessible large language models via k-bit quantization for PyTorch.☆6,299Updated this week
- Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"☆10,776Updated 3 months ago
- Transformer related optimization, including BERT, GPT☆5,890Updated 7 months ago
- LAVIS - A One-stop Library for Language-Vision Intelligence☆9,943Updated this week
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆16,471Updated this week
- Using Low-rank adaptation to quickly fine-tune diffusion models.☆7,070Updated 7 months ago
- 🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.☆26,242Updated this week
- An open source implementation of CLIP.☆10,344Updated last week
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,059Updated 5 months ago
- PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation☆4,823Updated 3 months ago
- RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…☆12,672Updated this week
- Ongoing research training transformer models at scale☆10,595Updated this week
- Official repo for consistency models.☆6,168Updated 7 months ago
- An open-source framework for training large multimodal models.☆3,750Updated 2 months ago
- AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (N…☆4,561Updated 3 weeks ago
- Simple, safe way to store and distribute tensors☆2,900Updated 2 weeks ago
- Train transformer language models with reinforcement learning.☆10,086Updated this week
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters☆5,760Updated 8 months ago
- Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"☆6,369Updated 5 months ago
- PyTorch extensions for high performance and large scale training.☆3,195Updated last week
- Development repository for the Triton language and compiler☆13,443Updated this week
- Foundation Architecture for (M)LLMs☆3,034Updated 7 months ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆35,508Updated this week
- Let us control diffusion models!☆30,421Updated 8 months ago
- Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.☆3,723Updated 3 months ago
- A concise but complete full-attention transformer with a set of promising experimental features from various papers☆4,793Updated this week
- High-Resolution Image Synthesis with Latent Diffusion Models☆11,890Updated 8 months ago
- 🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools☆2,576Updated this week