Alternatives and similar repositories for t-jepa

Users that are interested in t-jepa are comparing it to the libraries listed below

• Algomancer / The-Daily-Train
  Training Models Daily
  ☆17Updated 2 years ago
• SmerkyG / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆12Updated last month
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• cloneofsimo / zeroshampoo
  ☆34Updated last year
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆68Updated 2 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated this week
• CERC-AAI / Robin
  ☆63Updated last year
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆75Updated 2 years ago
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆28Updated 8 months ago
• euclaise / supertrainer2000
  ☆50Updated last year
• xjdr-alt / muzero_sketch
  ☆40Updated last year
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆103Updated last year
• sfcompute / tinynarrations
  A synthetic story narration dataset to study small audio LMs.
  ☆31Updated last year
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆109Updated 10 months ago
• Aleph-Alpha-Research / scaling
  Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…
  ☆66Updated last month
• catid / lllm
  Latent Large Language Models
  ☆19Updated last year
• BlinkDL / SmallInitEmb
  LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
  ☆61Updated 3 years ago
• okarthikb / state-space-models
  ☆27Updated last year
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆18Updated 5 months ago
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated last month
• Zyphra / Zyda_processing
  ☆39Updated last year
• theAdamColton / ijepa-enhanced
  recipe for training fully-featured self supervised image jepa models
  ☆12Updated 7 months ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated last year
• fal-ai-community / llmdifftracker
  Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)
  ☆34Updated 10 months ago
• QuixiAI / grokadamw
  ☆137Updated last year
• ClashLuke / SOAP
  ☆22Updated last year
• graphcore-research / jax-scalify
  JAX Scalify: end-to-end scaled arithmetics
  ☆17Updated last year
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated 2 years ago
• EleutherAI / training-jacobian
  ☆24Updated last year
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 3 months ago