A PyTorch implementation of Perceiver, Perceiver IO and Perceiver AR with PyTorch Lightning scripts for distributed training
☆525Jan 2, 2024Updated 2 years ago
Alternatives and similar repositories for perceiver-io
Users that are interested in perceiver-io are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch☆1,200Aug 22, 2023Updated 2 years ago
- Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch☆94Apr 10, 2023Updated 3 years ago
- ☆254Mar 30, 2026Updated 2 weeks ago
- music generation with perceiver-ar model☆26Jul 20, 2022Updated 3 years ago
- Unofficial implementation of Perceiver IO☆128Jun 14, 2022Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Perceiver (transformer variant) implemented in JAX and Flax☆13Mar 29, 2021Updated 5 years ago
- This repository contains implementations and illustrative code to accompany DeepMind publications☆14,824Apr 1, 2026Updated last week
- Vector (and Scalar) Quantization, in Pytorch☆3,888Mar 30, 2026Updated 2 weeks ago
- ☆19Jul 31, 2025Updated 8 months ago
- Named tensors with first-class dimensions for PyTorch☆332Jun 14, 2023Updated 2 years ago
- SOTA Google's Perceiver-AR Music Transformer Implementation and Model☆104May 9, 2023Updated 2 years ago
- A concise but complete full-attention transformer with a set of promising experimental features from various papers☆5,816Mar 27, 2026Updated 2 weeks ago
- PyTorch examples powered by Lightning☆12Dec 28, 2022Updated 3 years ago
- Masked Visual Pre-training for Robotics☆246Apr 1, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- KErnel OPerationS, on CPUs and GPUs, with autodiff and without memory overflows☆1,170Updated this week
- Test pytorch code with minimal computational overhead☆26Jun 8, 2023Updated 2 years ago
- Hackable and optimized Transformers building blocks, supporting a composable construction.☆10,411Mar 30, 2026Updated 2 weeks ago
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆80Jan 7, 2026Updated 3 months ago
- Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.☆1,476May 2, 2025Updated 11 months ago
- Front-end for symbolic music AI models☆17Nov 20, 2025Updated 4 months ago
- Code release for SLIP Self-supervision meets Language-Image Pre-training☆788Feb 9, 2023Updated 3 years ago
- Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch☆39Sep 6, 2021Updated 4 years ago
- Official JAX implementation of MAGVIT: Masked Generative Video Transformer☆997Jan 17, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Toolbox of models, callbacks, and datasets for AI/ML researchers.☆1,752Jan 20, 2026Updated 2 months ago
- An open source implementation of CLIP.☆13,658Apr 6, 2026Updated last week
- Official code for Long Expressive Memory (ICLR 2022, Spotlight)☆70Mar 11, 2022Updated 4 years ago
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)☆9,450Feb 20, 2026Updated last month
- Revisiting Contrastive Methods for Unsupervised Learning of Visual Representations. [NeurIPS 2021]☆89Oct 2, 2021Updated 4 years ago
- Adam with minor modifications which give significant improvement☆19Aug 20, 2021Updated 4 years ago
- (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.☆21Jul 13, 2022Updated 3 years ago
- Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch☆1,271Oct 18, 2022Updated 3 years ago
- Elucidating the Design Space of Diffusion-Based Generative Models (EDM)☆1,941Mar 16, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.☆3,408May 19, 2025Updated 10 months ago
- TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.☆1,713Updated this week
- Structured state space sequence models☆2,875Jul 17, 2024Updated last year
- maximal update parametrization (µP)☆1,695Jul 17, 2024Updated last year
- LAVIS - A One-stop Library for Language-Vision Intelligence☆11,192Nov 18, 2024Updated last year
- Learning Features with Parameter-Free Layers, ICLR 2022☆84May 3, 2023Updated 2 years ago
- [ECCV2022] New benchmark for evaluating pre-trained model; New supervised contrastive learning framework.☆110Dec 8, 2023Updated 2 years ago