new optimizer
☆20Aug 4, 2024Updated 2 years ago
Alternatives and similar repositories for grokadamw
Users that are interested in grokadamw are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆136Sep 29, 2026Updated last month
- A basic pure pytorch implementation of flash attention☆17Oct 28, 2024Updated 2 years ago
- ☆16Feb 6, 2024Updated 2 years ago
- ☆24Mar 1, 2023Updated 3 years ago
- Latent Large Language Models☆19Aug 24, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Scripts and tools for doing unsupervised acceptability prediction.☆14Mar 20, 2023Updated 3 years ago
- [COLM 2024] Early Weight Averaging meets High Learning Rates for LLM Pre-training☆19Oct 12, 2024Updated 2 years ago
- Experimental GPU language with meta-programming☆32Sep 6, 2024Updated 2 years ago
- A byte-level decoder architecture that matches the performance of tokenized Transformers.☆69Apr 24, 2024Updated 2 years ago
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆20Apr 26, 2022Updated 4 years ago
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆36Aug 14, 2024Updated 2 years ago
- ☆13Feb 3, 2025Updated last year
- This repository contains code for the MicroAdam paper.☆21Dec 14, 2024Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆17Jun 16, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [CoLM 24] Official Repository of MambaByte: Token-free Selective State Space Model☆26Oct 12, 2024Updated 2 years ago
- Quick ADC☆27May 31, 2019Updated 7 years ago
- ☆13May 7, 2023Updated 3 years ago
- sync google contacts with information from the dominos data breach <3☆11May 24, 2021Updated 5 years ago
- Code for this paper "HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts via HyperNetwork"☆34Nov 29, 2023Updated 2 years ago
- Webcam demo for SKTBrain/DiscoGAN☆12Sep 11, 2019Updated 7 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆62Jun 21, 2023Updated 3 years ago
- Implementation of NIPS2023: Unleashing the Full Potential of Product Quantization for Large-Scale Image Retrieva☆11Nov 12, 2024Updated last year
- Train transformers on synthetic graph search problems to measure their scaling behavior and to do mechanistic analysis.☆11Oct 22, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Explainable complex question answering over RDF files via Llama Index.☆30Mar 6, 2023Updated 3 years ago
- Set up YOLOv8 on Jetson nano with Jetpack 4.6☆16Jan 2, 2024Updated 2 years ago
- This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.☆106Jul 1, 2024Updated 2 years ago
- ☆17Apr 2, 2025Updated last year
- Adding new tasks to T0 without catastrophic forgetting☆33Oct 20, 2022Updated 4 years ago
- GGML bindings that aim to be idiomatic Rust rather than directly corresponding to the C/C++ interface☆20Sep 25, 2023Updated 3 years ago
- Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Trans…☆12Updated this week
- Production RAG hallucination detection + self-healing pipeline — 5 checks, 3 healing strategies, zero external APIs☆14May 7, 2026Updated 6 months ago
- ☆60Nov 18, 2025Updated 11 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Analyzing LLM Alignment via Token distribution shift☆17Jan 26, 2024Updated 2 years ago
- ☆11May 24, 2024Updated 2 years ago
- [ACL 2025] TokAlign: Efficient Vocabulary Adaptation via Token Alignment☆12Jun 4, 2025Updated last year
- BLAS Library in Exo☆12Aug 15, 2026Updated 2 months ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆279Nov 3, 2023Updated 3 years ago
- Entropy Based Sampling and Parallel CoT Decoding☆17Oct 9, 2024Updated 2 years ago
- ☆12Mar 5, 2025Updated last year