Spectral Sphere Optimizer
☆104Jan 14, 2026Updated last month
Alternatives and similar repositories for Spectral-Sphere-Optimizer
Users that are interested in Spectral-Sphere-Optimizer are comparing it to the libraries listed below
Sorting:
- The loss landscape of Large Language Models resemble basin!☆36Jul 8, 2025Updated 7 months ago
- ☆24Feb 25, 2026Updated last week
- An official implementation of Random Policy Valuation is Enough for LLM Reasoning with Verifiable Rewards☆37Oct 3, 2025Updated 5 months ago
- Measuring the Signal to Noise Ratio in Language Model Evaluation☆28Aug 19, 2025Updated 6 months ago
- My attempt to improve the speed of the newton schulz algorithm, starting from the dion implementation.☆32Dec 5, 2025Updated 3 months ago
- ☆87Updated this week
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 3 months ago
- Code publication to the paper "Normalized Attention Without Probability Cage"☆17Nov 9, 2021Updated 4 years ago
- ROSA+: RWKV's ROSA implementation with fallback statistical predictor☆32Oct 13, 2025Updated 4 months ago
- ☆55Feb 24, 2026Updated last week
- ☆20Oct 10, 2025Updated 4 months ago
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆44Nov 19, 2025Updated 3 months ago
- Research work aimed at addressing the problem of modeling infinite-length context☆46Dec 18, 2025Updated 2 months ago
- ☆38Aug 7, 2025Updated 6 months ago
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆91Feb 23, 2026Updated last week
- Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence☆58Nov 11, 2025Updated 3 months ago
- implementations and experimentation on mHC by deepseek - https://arxiv.org/abs/2512.24880☆317Feb 17, 2026Updated 2 weeks ago
- ☆46May 20, 2025Updated 9 months ago
- 😊 TPTT: Transforming Pretrained Transformers into Titans☆59Nov 24, 2025Updated 3 months ago
- Stick-breaking attention☆62Jul 1, 2025Updated 8 months ago
- FlashTile is a CUDA Tile IR compiler that is compatible with NVIDIA's tileiras, targeting SM70 through SM121 NVIDIA GPUs.☆54Feb 6, 2026Updated 3 weeks ago
- ☆32May 31, 2025Updated 9 months ago
- [arxiv: 2512.19673] Bottom-up Policy Optimization: Your Language Model Policy Secretly Contains Internal Policies☆61Feb 6, 2026Updated 3 weeks ago
- Compression for unit-norm embedding vectors using spherical coordinates☆76Jan 23, 2026Updated last month
- ScalingOpt - Optimization Community☆80Updated this week
- toy reproduction of Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts☆31Sep 1, 2024Updated last year
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- DeeperGEMM: crazy optimized version☆74May 5, 2025Updated 9 months ago
- Sparse Backpropagation for Mixture-of-Expert Training☆29Jul 2, 2024Updated last year
- PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"☆37Oct 11, 2023Updated 2 years ago
- [WIP] Better (FP8) attention for Hopper☆32Feb 24, 2025Updated last year
- Transformers components but in Triton☆34May 9, 2025Updated 9 months ago
- The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…☆84Jan 12, 2025Updated last year
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆247Sep 12, 2025Updated 5 months ago
- ☆108Feb 19, 2026Updated 2 weeks ago
- NSA Triton Kernels written with GPT5 and Opus 4.1☆70Aug 12, 2025Updated 6 months ago
- Kinematic and dynamic models of continuum and articulated soft robots.☆15Nov 22, 2025Updated 3 months ago
- ☆20Oct 18, 2025Updated 4 months ago
- vTPM with SGX protection☆11May 30, 2019Updated 6 years ago