model-architectures / GRAPELinks
[ICLR 2026] GRAPE: Group Representational Position Encoding (https://arxiv.org/abs/2512.07805)
☆78Updated 2 weeks ago
Alternatives and similar repositories for GRAPE
Users that are interested in GRAPE are comparing it to the libraries listed below
Sorting:
- Esoteric Language Models☆111Updated this week
- The official github repo for "Diffusion Language Models are Super Data Learners".☆220Updated 3 months ago
- Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…☆120Updated last month
- ☆67Updated 10 months ago
- [ICLR 2026] RPG: KL-Regularized Policy Gradient (https://arxiv.org/abs/2505.17508)☆65Updated last week
- Code accompanying the paper "Generalized Interpolating Discrete Diffusion"☆113Updated 8 months ago
- Model Merging with Functional Dual Anchors☆45Updated 2 months ago
- Universal Reasoning Model☆122Updated 3 weeks ago
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆86Updated 4 months ago
- Extending the Context of Pretrained LLMs by Dropping Their Positional Embedding☆200Updated 3 weeks ago
- Fork of Flame repo for training of some new stuff in development☆19Updated last month
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28Updated 9 months ago
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆56Updated 10 months ago
- Supporting code for the blog post on modular manifolds.☆115Updated 4 months ago
- A repository for research on medium sized language models.☆77Updated last year
- RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…☆54Updated 3 weeks ago
- An official implementation of Random Policy Valuation is Enough for LLM Reasoning with Verifiable Rewards☆36Updated 4 months ago
- 📄Small Batch Size Training for Language Models☆80Updated 4 months ago
- RND1: Scaling Diffusion Language Models☆172Updated 3 weeks ago
- ☆24Updated 8 months ago
- H-Net Dynamic Hierarchical Architecture☆81Updated 4 months ago
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆150Updated 4 months ago
- Defeating the Training-Inference Mismatch via FP16☆181Updated 2 months ago
- Code for the paper "Function-Space Learning Rates"☆25Updated 8 months ago
- ☆270Updated 8 months ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated 4 months ago
- Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".☆144Updated 2 months ago
- Official Implementation of Dynamic erf (Derf).☆127Updated last month
- Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind☆59Updated 8 months ago
- ☆91Updated last year