Alternatives and similar repositories for jepa:

Users that are interested in jepa are comparing it to the libraries listed below

• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆49Updated 6 months ago
• lucidrains / spline-based-transformer
  Implementation of the proposed Spline-Based Transformer from Disney Research
  ☆86Updated 3 months ago
• lucidrains / vit-arc-slot
  Explorations into improving ViTArc with Slot Attention
  ☆37Updated 4 months ago
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆116Updated 4 months ago
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆44Updated this week
• lucidrains / mirasol-pytorch
  Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
  ☆88Updated last year
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆87Updated 8 months ago
• enajx / HyperNCA
  ☆37Updated 2 years ago
• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆23Updated last month
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆95Updated last month
• lucidrains / gradnorm-pytorch
  A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch
  ☆85Updated last year
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆44Updated last year
• cloneofsimo / d3pm
  Minimal Implementation of a D3PM in pytorch
  ☆196Updated 10 months ago
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆90Updated 7 months ago
• lucidrains / coordinate-descent-attention
  Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
  ☆46Updated last year
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆120Updated 6 months ago
• lucidrains / genetic-algorithm-pytorch
  Toy genetic algorithm in Pytorch
  ☆33Updated 2 weeks ago
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆61Updated 6 months ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆109Updated last month
• vladisai / JEPA_SSL_NeurIPS_2022
  A repository for paper Joint Embedding Predictive Architectures Focus on Slow Features
  ☆21Updated 2 years ago
• lucidrains / kalman-filtering-attention
  Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
  ☆57Updated last year
• lucidrains / recurrent-interface-network-pytorch
  Implementation of Recurrent Interface Network (RIN), for highly efficient generation of images and video without cascading networks, in P…
  ☆200Updated last year
• Rose-STL-Lab / LieGAN
  ☆33Updated last year
• hyperevolnet / Terminator
  The official repository for HyperZ⋅Z⋅W Operator Connects Slow-Fast Networks for Full Context Interaction.
  ☆31Updated last week
• huyphan168 / PEER
  Mixture of A Million Experts
  ☆40Updated 6 months ago
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆17Updated last year