shibhansh / loss-of-plasticity
Demonstrations of Loss of Plasticity and Implementation of Continual Backpropagation
☆188Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for loss-of-plasticity
- Benchmarking RL for POMDPs in Pure JAX [Code for "Structured State Space Models for In-Context Reinforcement Learning" (NeurIPS 2023)]☆87Updated 11 months ago
- ☆261Updated 3 months ago
- Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch☆247Updated 6 months ago
- ☆167Updated 5 months ago
- ☆58Updated 2 years ago
- Implementation of Forward Forward Network proposed by Hinton in NIPS 2022.☆162Updated last year
- Easy Hypernetworks in Pytorch and Jax☆96Updated last year
- Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)☆64Updated 6 months ago
- This is the official code release for Bayesian Flow Networks.☆256Updated 4 months ago
- Code for the paper "Inference via Interpolation: Contrastive Representations Provably Enable Planning and Inference"☆37Updated 4 months ago
- PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.☆70Updated 8 months ago
- This repository contains the code for the paper "Inferring Neural Activity Before Plasticity: A Foundation for Learning Beyond Backpropag…☆80Updated 10 months ago
- Implementation of the proposed minGRU in Pytorch☆246Updated last week
- Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch☆293Updated 5 months ago
- Decomposing and Editing Predictions by Modeling Model Computation☆124Updated 5 months ago
- Package for working with hypernetworks in PyTorch.☆117Updated last year
- A modular, easy to extend GFlowNet library☆233Updated this week
- Brain-Inspired Modular Training (BIMT), a method for making neural networks more modular and interpretable.☆162Updated last year
- Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).☆102Updated last month
- NF-Layers for constructing neural functionals.☆75Updated 10 months ago
- Collection of papers on state-space models☆556Updated 2 weeks ago
- ICML 2022: Learning Iterative Reasoning through Energy Minimization☆43Updated last year
- ☆48Updated 9 months ago
- Kolmogorov–Arnold Networks with modified activation (using MLP to represent the activation)☆103Updated 3 weeks ago
- Official source code for "Graph Neural Networks for Learning Equivariant Representations of Neural Networks". In ICLR 2024 (oral).☆70Updated 3 months ago
- TorchOpt is an efficient library for differentiable optimization built upon PyTorch.☆545Updated 2 weeks ago
- Code for the tutorial/review paper for RL-based-fine-tuniing. In this code, we especially focus on the design of biological sequences li…☆77Updated 2 months ago
- ViT Prisma is a mechanistic interpretability library for Vision Transformers (ViTs).☆179Updated this week
- ☆149Updated this week
- Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)☆47Updated 2 weeks ago