minyoungg / platonic-repLinks
β567Updated 2 months ago
Alternatives and similar repositories for platonic-rep
Users that are interested in platonic-rep are comparing it to the libraries listed below
Sorting:
- [ICLR2025 Spotlightπ₯] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parametersβ562Updated 4 months ago
- Muon: An optimizer for hidden layers in neural networksβ897Updated 2 weeks ago
- Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"β315Updated 7 months ago
- ViT Prisma is a mechanistic interpretability library for Vision and Video Transformers (ViTs).β275Updated 2 weeks ago
- β286Updated 2 months ago
- Helpful tools and examples for working with flex-attentionβ846Updated this week
- Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAIβ285Updated 3 weeks ago
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelsβ703Updated 2 months ago
- β493Updated 11 months ago
- Implementation of π Ring Attention, from Liu et al. at Berkeley AI, in Pytorchβ521Updated last month
- This repo contains the code for the paper "Intuitive physics understanding emerges fromself-supervised pretraining on natural videos"β164Updated 4 months ago
- [ICML 2024 Best Paper] Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)β586Updated last year
- Official JAX implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden Statesβ412Updated 10 months ago
- Annotated version of the Mamba paperβ485Updated last year
- code for "Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion"β898Updated 2 months ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, sparsβ¦β339Updated 6 months ago
- When do we not need larger vision models?β395Updated 4 months ago
- [NeurIPS 2024] Simple and Effective Masked Diffusion Language Modelβ433Updated 3 weeks ago
- Official implementation of paper: SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingβ281Updated last month
- [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptationβ803Updated 8 months ago
- This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Eβ¦β447Updated last month
- Some preliminary explorations of Mamba's context scaling.β214Updated last year
- Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.β423Updated last year
- GPT4 based personalized ArXiv paper assistant botβ525Updated last year
- Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorchβ341Updated last year
- πΎ OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.β383Updated 2 weeks ago
- A curated list for awesome discrete diffusion models resources.β380Updated 3 weeks ago
- [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Modelsβ221Updated last month
- Pretraining code for a large-scale depth-recurrent language modelβ783Updated 2 weeks ago
- PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attentionβ¦β289Updated last year