Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"
☆31Jul 30, 2020Updated 5 years ago
Alternatives and similar repositories for LaProp-Optimizer
Users that are interested in LaProp-Optimizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Mar 2, 2025Updated last year
- OpenAI CLIP based image generator with complex config file controlled transformation and training pipelines☆19Jan 4, 2022Updated 4 years ago
- recipe for training fully-featured self supervised image jepa models☆14Jun 4, 2025Updated last year
- Code for "What really matters in matrix-whitening optimizers?"☆24Oct 31, 2025Updated 7 months ago
- ☆35Apr 12, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- High performance pytorch modules☆18Jan 14, 2023Updated 3 years ago
- Custom triton kernels for training Karpathy's nanoGPT.☆19Oct 21, 2024Updated last year
- H-Net Dynamic Hierarchical Architecture☆81Sep 11, 2025Updated 8 months ago
- an implementation of FAdam (Fisher Adam) in PyTorch☆52Jul 1, 2025Updated 11 months ago
- Utility to use eleven lab's streaming to in the command line☆11Aug 8, 2023Updated 2 years ago
- implementation of https://arxiv.org/pdf/2312.09299☆21Jul 3, 2024Updated last year
- An implementation of PSGD Kron second-order optimizer for PyTorch☆102Jul 24, 2025Updated 10 months ago
- Minimal Transformer base in JAX. A single backbone for language modelling, diffusion, classification, etc...☆16May 28, 2025Updated last year
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"☆15Apr 30, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 📄Small Batch Size Training for Language Models☆81Mar 18, 2026Updated 2 months ago
- ☆11Sep 10, 2023Updated 2 years ago
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆134Jun 24, 2025Updated 11 months ago
- One-stop shop for running and fine-tuning transformer-based language models for retrieval☆65May 31, 2026Updated last week
- An official repository for GPTailor☆18Jun 29, 2025Updated 11 months ago
- Spearmint uses Gaussian Processes to automatically optimize hyper parameter. This is a fork of Spearmint for the deep learning community.…☆11Nov 30, 2016Updated 9 years ago
- Official implementation of the paper "You Do Not Fully Utilize Transformer's Representation Capacity"☆32May 28, 2025Updated last year
- POPGym Library in JAX☆14Apr 15, 2024Updated 2 years ago
- ☆14Jul 13, 2025Updated 10 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Integrates Imbue's Cost Aware pareto-Region Bayesian Search (CARBS) with Weights and Biases (WanDB)☆12Mar 17, 2025Updated last year
- ☆22Sep 16, 2025Updated 8 months ago
- Official repo for paper "HiMoE-VLA: Hierarchical Mixture-of-Experts for Generalist Vision-Language-Action Policies"☆33Dec 12, 2025Updated 5 months ago
- Rust port of pandoc-types☆16Feb 11, 2023Updated 3 years ago
- Repo to reproduce the First-Explore paper results☆39May 6, 2026Updated last month
- ☆10Jun 27, 2024Updated last year
- Minimal Implimentation of VCRec (2024) for collapse provention.☆18Jan 28, 2025Updated last year
- torch implementation of diloco☆23May 31, 2024Updated 2 years ago
- 32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.☆50Jun 16, 2023Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Measuring the Signal to Noise Ratio in Language Model Evaluation☆29Aug 19, 2025Updated 9 months ago
- OpenAI gym environments for goal-conditioned and language-conditioned reinforcement learning☆14Jan 27, 2026Updated 4 months ago
- ☆11Jan 21, 2020Updated 6 years ago
- The implementation of "The Kanerva Machine" with Pytorch and Pyro☆12Jun 14, 2018Updated 7 years ago
- A simple library for scaling up JAX programs☆147Nov 4, 2025Updated 7 months ago
- ☆19Jun 29, 2025Updated 11 months ago
- support Large Vocabulary Instance Segmentation (LVIS) dataset for mmdetection☆16Apr 24, 2020Updated 6 years ago