NeuroCompLab-psu / SpikingBERT
This project contains code for the paper titled "SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation".
☆12Updated 9 months ago
Related projects ⓘ
Alternatives and complementary repositories for SpikingBERT
- GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networks, NeurIPS 2022 Poster☆49Updated last year
- ☆45Updated 10 months ago
- A rough implementation of SpikeBERT☆16Updated 7 months ago
- PyTorch Implementation of Exploring Temporal Information Dynamics in Spiking Neural Networks (AAAI23)☆22Updated last year
- Membrane Potential Batch Normalization for Spiking Neural Networks☆19Updated last year
- Official repository of SpikeZIP-TF in ICML2024☆31Updated 5 months ago
- Offical code of "QKFormer: Hierarchical Spiking Transformer using Q-K Attention" (NeurIPS 2024，Spotlight 3%)☆73Updated last week
- [ICLR 2024] Hebbian Learning based Orthogonal Projection for Continual Learning of Spiking Neural Networks☆28Updated 9 months ago
- [NeurIPS 2022] Online Training Through Time for Spiking Neural Networks☆53Updated 11 months ago
- Exploring Lottery Ticket Hypothesis in Sparse Spiking Neural Networks (ECCV2022, oral presentation)☆32Updated 2 years ago
- ICLR 2023, Spiking Convolutional Neural Networks for Text Classification☆26Updated 4 months ago
- [TNNLS 2024] Implementation of "TCJA-SNN: Temporal-Channel Joint Attention for Spiking Neural Networks"☆46Updated 7 months ago
- Pytorch implementation of Neuromorphic Data Augmentation for SNN, Accepted to ECCV 2022.☆36Updated last year
- code for generating data set ES-ImageNet with corresponding training code☆29Updated 5 months ago
- Codes of the paper: SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networks (CVPR2024)☆38Updated 6 months ago
- Offical implementation of "Attention Spiking Neural Networks" (IEEE T-PAMI2023)☆62Updated 6 months ago
- Offical implementation of "Inherent Redundancy in Spiking Neural Networks" (ICCV2023)☆25Updated 10 months ago
- Pytorch implementation of SEENN (Spiking Early Exit Neural Networks) (NeurIPS 2023)☆11Updated this week
- Enhancing the Performance of Transformer-based Spiking Neural Networks by SNN-optimized Downsampling with Precise Gradient Backpropagatio…☆37Updated 4 months ago
- [NeurIPS 2021] Training Feedback Spiking Neural Networks by Implicit Differentiation on the Equilibrium State☆28Updated 3 years ago
- ☆47Updated last year
- [WACV 2024] Spiking Denoising Diffusion Probabilistic Models☆36Updated 7 months ago
- Advancing Spiking Neural Networks towards Deep Residual Learning☆44Updated 8 months ago
- Offical implementation of "Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation …☆139Updated 6 months ago
- Ternary Spike: Learning Ternary Spikes for Spiking Neural Networks☆16Updated 11 months ago
- Create a new backward path for more accurate SNN gradients.☆13Updated 3 months ago
- Code and data to the publication "SpikE: spike-based embeddings for multi-relational graph data".☆13Updated last year
- Official code of "AutoSNN: Towards Energy-Efficient Spiking Neural Networks," ICML22☆17Updated 2 years ago
- Offical implementation of High-Performance Temporal Reversible Spiking Neural Networks with $O(L)$ Training Memory and $O(1)$ Inference C…☆10Updated last month
- ☆15Updated last year