Lvchangze / SpikeBERTLinks
Official Implementation of Paper "SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation".
☆22Updated 3 months ago
Alternatives and similar repositories for SpikeBERT
Users that are interested in SpikeBERT are comparing it to the libraries listed below
Sorting:
- ☆50Updated last year
- This project contains code for the paper titled "SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentia…☆24Updated last year
- [ICLR 2023] Spiking Convolutional Neural Networks for Text Classification☆33Updated last year
- GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networks, NeurIPS 2022 Poster☆51Updated 2 years ago
- Offical implementation of "Spike-driven Transformer" (NeurIPS2023)☆262Updated last year
- Awesome Spiking Neural Networks☆133Updated 3 months ago
- Spikingformer: Spike-driven Residual Learning for Transformer-based Spiking Neural Network☆103Updated 7 months ago
- Offical implementation of "Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation …☆187Updated last year
- SyOPs counter for spiking neural networks☆63Updated 2 years ago
- [ICCV2023] Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks☆43Updated last year
- [TNNLS 2024] Implementation of "TCJA-SNN: Temporal-Channel Joint Attention for Spiking Neural Networks"☆56Updated last year
- ICLR 2023, Spikformer: When Spiking Neural Network Meets Transformer☆344Updated last year
- ☆29Updated last year
- Offical implementation of "Attention Spiking Neural Networks" (IEEE T-PAMI2023)☆81Updated last year
- [CVPR 2022] Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representation☆51Updated 2 years ago
- Offical implementation of "Scaling Spike-driven Transformer with Efficient Spike Firing Approximation Training" (IEEE T-PAMI2025)☆75Updated last month
- [NeurIPS 2024] Advancing Training Efficiency of Deep Spiking Neural Networks through Rate-based Backpropagation☆17Updated 6 months ago
- Offical implementation of "Quantized Spike-driven Transformer" (ICLR2025)☆24Updated 3 months ago
- [NeurIPS 2022] Online Training Through Time for Spiking Neural Networks☆63Updated last year
- ☆53Updated last year
- Offical code of "QKFormer: Hierarchical Spiking Transformer using Q-K Attention" (NeurIPS 2024，Spotlight 3%)☆119Updated 6 months ago
- Ternary Spike: Learning Ternary Spikes for Spiking Neural Networks☆21Updated last year
- Deep Residual Learning in Spiking Neural Networks☆170Updated 2 years ago
- Intelligent-Computing-Lab-Panda / Exploring-Temporal-Information-Dynamics-in-Spiking-Neural-NetworksPyTorch Implementation of Exploring Temporal Information Dynamics in Spiking Neural Networks (AAAI23)☆28Updated 2 years ago
- The code of SpikingSSMs: Learning Long Sequences with Sparse and Parallel Spiking State Space Models☆13Updated 3 months ago
- ☆17Updated last year
- ☆45Updated last year
- Create a new backward path for more accurate SNN gradients.☆16Updated 11 months ago
- Pytorch Implementation of Spiking Neural Networks Calibration, ICML 2021☆87Updated last year
- An event-driven learning algorithm for spiking neural networks☆30Updated last year