lucidrains / x-transformers
A concise but complete full-attention transformer with a set of promising experimental features from various papers
ā4,573Updated last week
Related projects: ā
- š A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (iā¦ā7,687Updated this week
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)ā8,362Updated this week
- š¦ Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorchā2,002Updated 3 months ago
- Implementation of Denoising Diffusion Probabilistic Model in Pytorchā7,916Updated 2 weeks ago
- Structured state space sequence modelsā2,361Updated 2 months ago
- Vector (and Scalar) Quantization, in Pytorchā2,404Updated this week
- Foundation Architecture for (M)LLMsā3,003Updated 5 months ago
- Fast and memory-efficient exact attentionā13,401Updated this week
- A collection of resources and papers on Diffusion Modelsā10,758Updated last month
- Denoising Diffusion Probabilistic Modelsā3,637Updated last year
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.ā2,206Updated this week
- Scenic: A Jax Library for Computer Vision Research and Beyondā3,248Updated 3 weeks ago
- Diffusion model papers, survey, and taxonomyā2,894Updated last month
- PyTorch extensions for high performance and large scale training.ā3,149Updated 2 weeks ago
- ā6,068Updated 2 months ago
- Pytorch library for fast transformer implementationsā1,621Updated last year
- An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websitesā4,541Updated last month
- An open source implementation of CLIP.ā9,782Updated last month
- Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.ā2,206Updated 3 weeks ago
- A Unified Library for Parameter-Efficient and Modular Transfer Learningā2,525Updated 3 weeks ago
- Release for Improved Denoising Diffusion Probabilistic Modelsā3,136Updated 2 months ago
- Hackable and optimized Transformers building blocks, supporting a composable construction.ā8,351Updated this week
- Model interpretability and understanding for PyTorchā4,810Updated this week
- Train transformer language models with reinforcement learning.ā9,288Updated this week
- Accessible large language models via k-bit quantization for PyTorch.ā6,029Updated this week
- PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ā”š„ā”ā4,092Updated last month
- ā10,072Updated 3 months ago
- TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.ā1,423Updated this week
- Flax is a neural network library for JAX that is designed for flexibility.ā5,950Updated this week
- Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications.ā2,077Updated this week