NeuroCompLab-psu / SpikingBERT
This project contains code for the paper titled "SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation".
☆20Updated last year
Alternatives and similar repositories for SpikingBERT
Users that are interested in SpikingBERT are comparing it to the libraries listed below
Sorting:
- GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networks, NeurIPS 2022 Poster☆51Updated 2 years ago
- Official Implementation of Paper "SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation".☆21Updated last month
- ☆51Updated last year
- PyTorch Implementation of Exploring Temporal Information Dynamics in Spiking Neural Networks (AAAI23)☆28Updated 2 years ago
- This is the official project repository for BKDSNN: Enhancing the Performance of Learning-based Spiking Neural Networks Training with Blu…☆27Updated 5 months ago
- [ICLR 2024] Hebbian Learning based Orthogonal Projection for Continual Learning of Spiking Neural Networks☆36Updated last year
- Exploring Lottery Ticket Hypothesis in Sparse Spiking Neural Networks (ECCV2022, oral presentation)☆34Updated 2 years ago
- Create a new backward path for more accurate SNN gradients.☆16Updated 8 months ago
- Official repository of SpikeZIP-TF in ICML2024☆36Updated 5 months ago
- Pytorch implementation of SEENN (Spiking Early Exit Neural Networks) (NeurIPS 2023)☆15Updated 5 months ago
- Official Implementation of ICLR 2023 Paper "Spiking Convolutional Neural Networks for Text Classification".☆32Updated 10 months ago
- Official code of "AutoSNN: Towards Energy-Efficient Spiking Neural Networks," ICML22☆18Updated 2 years ago
- ☆29Updated last year
- [TNNLS 2024] Implementation of "TCJA-SNN: Temporal-Channel Joint Attention for Spiking Neural Networks"☆55Updated last year
- [NeurIPS 2024] Advancing Training Efficiency of Deep Spiking Neural Networks through Rate-based Backpropagation☆16Updated 3 months ago
- code for generating data set ES-ImageNet with corresponding training code☆31Updated 11 months ago
- ☆54Updated 2 years ago
- Pytorch Implementation of Spiking Neural Networks Calibration, ICML 2021☆87Updated last year
- [ICCV-23] Masked Spiking Transformer☆32Updated 2 months ago
- Membrane Potential Batch Normalization for Spiking Neural Networks☆19Updated last year
- Ternary Spike: Learning Ternary Spikes for Spiking Neural Networks☆21Updated last year
- This is the implentation of our paper "SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms" in ICML…☆36Updated 10 months ago
- Offical implementation of "Inherent Redundancy in Spiking Neural Networks" (ICCV2023)☆27Updated last year
- ☆15Updated 2 years ago
- [NeurIPS 2021] Training Feedback Spiking Neural Networks by Implicit Differentiation on the Equilibrium State☆29Updated 3 years ago
- Advancing Spiking Neural Networks towards Deep Residual Learning☆51Updated last month
- [ICCV2023] Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks☆42Updated last year
- [NeurIPS 2022] Online Training Through Time for Spiking Neural Networks☆60Updated last year
- Offical implementation of "Attention Spiking Neural Networks" (IEEE T-PAMI2023)☆79Updated 11 months ago
- ☆17Updated 2 years ago