[Neural Networks] SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation
☆29Apr 11, 2025Updated last year
Alternatives and similar repositories for SpikeBERT
Users that are interested in SpikeBERT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2023] Spiking Convolutional Neural Networks for Text Classification☆35Jul 12, 2024Updated last year
- This project contains code for the paper titled "SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentia…☆28Feb 21, 2024Updated 2 years ago
- This is the implentation of our paper "SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms" in ICML…☆46Jul 9, 2024Updated last year
- ICLR 2023, Spikformer: When Spiking Neural Network Meets Transformer☆400Jan 23, 2024Updated 2 years ago
- Offical implementation of "Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation …☆229May 10, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆55Jan 21, 2024Updated 2 years ago
- [TNNLS 2024] Implementation of "TCJA-SNN: Temporal-Channel Joint Attention for Spiking Neural Networks"☆61Apr 16, 2024Updated 2 years ago
- [ICML 2024] Temporal Spiking Neural Networks with Synaptic Delay for Graph Reasoning☆11Jun 1, 2024Updated last year
- Create a new backward path for more accurate SNN gradients.☆17Aug 19, 2024Updated last year
- ☆16Feb 22, 2024Updated 2 years ago
- Code for paper "Optimal ANN-SNN conversion for high-accuracy and ultra-low-latency spiking neural networks"☆42Oct 2, 2023Updated 2 years ago
- Offical implementation of "Scaling Spike-driven Transformer with Efficient Spike Firing Approximation Training" (IEEE T-PAMI2025)☆111May 20, 2025Updated last year
- The code of SpikingSSMs: Learning Long Sequences with Sparse and Parallel Spiking State Space Models☆23Mar 25, 2026Updated 2 months ago
- ☆19Feb 18, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆88Feb 8, 2026Updated 3 months ago
- ☆24Jan 27, 2026Updated 4 months ago
- Offical implementation of "MetaLA: Unified Optimal Linear Approximation to Softmax Attention Map" (NeurIPS2024 Oral)☆36Jan 18, 2025Updated last year
- A benchmark suite for evaluating Spiking Neural Networks (SNNs) on temporal processing tasks, comparing abilities of SNN-related models a…☆21Aug 14, 2025Updated 9 months ago
- Offical implementation of "Spike-driven Transformer" (NeurIPS2023)☆313Mar 18, 2024Updated 2 years ago
- ☆20Dec 14, 2023Updated 2 years ago
- Offical code of "QKFormer: Hierarchical Spiking Transformer using Q-K Attention" (NeurIPS 2024)☆146Apr 16, 2026Updated last month
- ☆56Dec 8, 2022Updated 3 years ago
- ☆36Jan 20, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Official repository of SpikeZIP-TF in ICML2024☆52Dec 4, 2024Updated last year
- ☆54Dec 2, 2023Updated 2 years ago
- Official implementation of "Learning Delays in Spiking Neural Networks using Dilated Convolutions with Learnable Spacings" [ICLR2024]☆66Apr 24, 2024Updated 2 years ago
- code for generating data set ES-ImageNet with corresponding training code☆31Jun 4, 2024Updated last year
- Awesome Spiking Neural Networks☆148Mar 24, 2025Updated last year
- The source code for "LaSe-E2V: Towards Language-guided Semantic-Aware Event-to-Video Reconstruction"☆10Jul 5, 2024Updated last year
- [ICCV-23 + IJCV-26] Masked Spiking Transformer☆32May 10, 2026Updated 2 weeks ago
- Deep Residual Learning in Spiking Neural Networks☆192Aug 9, 2022Updated 3 years ago
- Offical implementation of "Quantized Spike-driven Transformer" (ICLR2025)☆33Dec 23, 2025Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12Jan 17, 2024Updated 2 years ago
- ☆12Jul 6, 2023Updated 2 years ago
- ☆12Feb 25, 2025Updated last year
- GOMIL: Global Optimization of Multiplier by Integer Linear Programming☆13Aug 25, 2021Updated 4 years ago
- An event-driven learning algorithm for spiking neural networks☆28May 15, 2024Updated 2 years ago
- An example Hardware Processing Engine☆12Feb 4, 2023Updated 3 years ago
- This is the implentation of our paper "SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking" i…☆49Mar 2, 2025Updated last year