AlxSp / t-jepaLinks
☆12Updated last year
Alternatives and similar repositories for t-jepa
Users that are interested in t-jepa are comparing it to the libraries listed below
Sorting:
- Training Models Daily☆17Updated 2 years ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- ☆40Updated last year
- Collection of autoregressive model implementation☆85Updated last month
- ☆50Updated last year
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28Updated 9 months ago
- ☆27Updated last year
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated last week
- GoldFinch and other hybrid transformer components☆12Updated 2 months ago
- DeMo: Decoupled Momentum Optimization☆198Updated last year
- Cerule - A Tiny Mighty Vision Model☆68Updated 3 months ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆18Updated 6 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆103Updated last year
- ☆63Updated last year
- GoldFinch and other hybrid transformer components☆45Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated 2 years ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- https://hf.co/hexgrad/Kokoro-82M☆14Updated 3 weeks ago
- ☆34Updated last year
- Simplex Random Feature attention, in PyTorch☆75Updated 2 years ago
- ☆19Updated 2 months ago
- H-Net Dynamic Hierarchical Architecture☆81Updated 5 months ago
- A minimal implementation of Drifting Models for 2D toy data. Unlike diffusion/flow models that iterate at inference, drifting models evo…☆39Updated this week
- ☆24Updated last year
- Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)☆34Updated 11 months ago
- ☆82Updated last year
- ☆47Updated 2 years ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆110Updated 11 months ago
- new optimizer☆20Updated last year
- Experiments for efforts to train a new and improved t5☆76Updated last year