nisten / grokadamw
new optimizer
☆19Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for grokadamw
- RWKV-7: Surpassing GPT☆45Updated this week
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 6 months ago
- ☆118Updated 3 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆40Updated 8 months ago
- look how they massacred my boy☆58Updated last month
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Updated 10 months ago
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆38Updated 5 months ago
- Because it's there.☆14Updated 2 months ago
- Latent Large Language Models☆16Updated 2 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated 10 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆23Updated 8 months ago
- ☆20Updated 2 weeks ago
- ☆64Updated 5 months ago
- One Line To Build Zero-Data Classifiers in Minutes☆33Updated last month
- Training Models Daily☆17Updated 11 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆113Updated 3 weeks ago
- ☆41Updated 2 weeks ago
- Lightweight tools for quick and easy LLM demo's☆26Updated last month
- Set of scripts to finetune LLMs☆36Updated 7 months ago
- ☆36Updated 3 months ago
- Cerule - A Tiny Mighty Vision Model☆67Updated 2 months ago
- ☆53Updated 5 months ago
- ☆49Updated 8 months ago
- Collection of autoregressive model implementation☆67Updated this week
- ☆48Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆23Updated last week
- ☆15Updated last year
- Small, simple agent task environments for training and evaluation☆16Updated 2 weeks ago
- ☆43Updated 4 months ago