Alternatives and similar repositories for t-jepa:

Users that are interested in t-jepa are comparing it to the libraries listed below

• Algomancer / The-Daily-Train
  Training Models Daily
  ☆17Updated last year
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated last month
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated 11 months ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 11 months ago
• catid / lllm
  Latent Large Language Models
  ☆17Updated 8 months ago
• euclaise / supertrainer2000
  ☆49Updated last year
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• nisten / grokadamw
  new optimizer
  ☆19Updated 8 months ago
• xjdr-alt / muzero_sketch
  ☆38Updated 9 months ago
• SmerkyG / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆10Updated 3 weeks ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated last year
• ClashLuke / SOAP
  ☆21Updated 5 months ago
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆27Updated 2 months ago
• SkunkworksAI / CodeFusion
  ☆15Updated last year
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆31Updated 8 months ago
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated this week
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated last month
• okarthikb / state-space-models
  ☆27Updated 9 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆96Updated last month
• ethansmith2000 / TransformerExperiments
  ☆19Updated 3 weeks ago
• sfcompute / tinynarrations
  A synthetic story narration dataset to study small audio LMs.
  ☆32Updated last year
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆98Updated 4 months ago
• fal-ai / diffusion-speedrun
  Focused on fast experimentation and simplicity
  ☆71Updated 4 months ago
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆67Updated 7 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 2 months ago
• Chillee / lit-llama
  Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code
  ☆10Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated 11 months ago
• qnguyen3 / hermes-llava
  ☆54Updated last year
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 6 months ago
• fal-ai-community / llmdifftracker
  Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)
  ☆33Updated last month