Alternatives and similar repositories for t-jepa

Users that are interested in t-jepa are comparing it to the libraries listed below

• Algomancer / The-Daily-Train
  Training Models Daily
  ☆17Updated 2 years ago
• xjdr-alt / muzero_sketch
  ☆40Updated last year
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆68Updated last month
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 2 months ago
• okarthikb / state-space-models
  ☆28Updated last year
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• catid / lllm
  Latent Large Language Models
  ☆19Updated last year
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated last year
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆28Updated 7 months ago
• CERC-AAI / Robin
  ☆63Updated last year
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆108Updated 9 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆103Updated 11 months ago
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆18Updated 4 months ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• euclaise / supertrainer2000
  ☆50Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 7 months ago
• cloneofsimo / zeroshampoo
  ☆34Updated last year
• ClashLuke / SOAP
  ☆21Updated last year
• SmerkyG / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆12Updated last week
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated last week
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆29Updated last month
• fal-ai-community / llmdifftracker
  Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)
  ☆34Updated 9 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated last year
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated last year
• LucasPrietoAl / grokking-at-the-edge-of-numerical-stability
  ☆105Updated 4 months ago
• nisten / grokadamw
  new optimizer
  ☆20Updated last year
• doomslide / autoloom
  Approximating the joint distribution of language models via MCTS
  ☆22Updated last year
• kubernetes-bad / reward-composer
  Lego for GRPO
  ☆30Updated 6 months ago
• yacineMTB / just-large-models
  Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.
  ☆44Updated 2 years ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated last year