This project contains code for the paper titled "SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation".
☆28Feb 21, 2024Updated 2 years ago
Alternatives and similar repositories for SpikingBERT
Users that are interested in SpikingBERT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [Neural Networks] SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation☆30Apr 11, 2025Updated last year
- Ternary Spike: Learning Ternary Spikes for Spiking Neural Networks☆29Dec 14, 2023Updated 2 years ago
- The code of SpikingSSMs: Learning Long Sequences with Sparse and Parallel Spiking State Space Models☆23Mar 25, 2026Updated 3 months ago
- Offical code of "QKFormer: Hierarchical Spiking Transformer using Q-K Attention"☆148May 25, 2026Updated last month
- LoAS: Fully Temporal-Parallel Dataflow for Dual-Sparse Spiking Neural Networks, MICRO 2024.☆19Mar 19, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Offical implementation of "Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation …☆229May 10, 2024Updated 2 years ago
- Offical implementation of "Spike-driven Transformer" (NeurIPS2023)☆315Mar 18, 2024Updated 2 years ago
- ☆31Jun 8, 2022Updated 4 years ago
- Update arXiv papers about Spiking Neural Networks daily.☆512May 17, 2026Updated last month
- Neuron-Astrocyte Liquid State Machine☆26Nov 24, 2021Updated 4 years ago
- [PokerEvent Benchmark Dataset & SNN-ANN Baseline, IEEE TCDS 2025] Official PyTorch implementation of "SSTFormer: Bridging Spiking Neural …☆22May 6, 2025Updated last year
- [ASP-DAC 2025] "NeuronQuant: Accurate and Efficient Post-Training Quantization for Spiking Neural Networks" Official Implementation☆19Mar 6, 2025Updated last year
- Codes for Spiking Neural Networks with Improved Inherent Recurrence Dynamics for Sequential Learning☆11May 5, 2022Updated 4 years ago
- Neuromorphic ASIC with 96 neurons on Tiny Tapeout 7☆11May 25, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [NeurIPS 2024] Spiking Graph Neural Networks on Riemannian Manifolds☆23Oct 22, 2024Updated last year
- SATA_Sim is an energy estimation framework for Backpropagation-Through-Time (BPTT) based Spiking Neural Networks (SNNs) training and infe…☆28Sep 23, 2024Updated last year
- Awesome Spiking Neural Networks☆149Mar 24, 2025Updated last year
- [ICML 2024] DPZero: Private Fine-Tuning of Language Models without Backpropagation☆17Sep 4, 2024Updated last year
- This repository is the implementation of the paper Training Free Pretrained Model Merging (CVPR2024).☆34Mar 5, 2024Updated 2 years ago
- Offical implementation of "Gated Attention Coding for Training High-performance and Efficient Spiking Neural Networks" (AAAI2024)☆120May 31, 2024Updated 2 years ago
- Two self-contained notebooks to perform "weight transformer" from pretrained Transformer model to neuron-astrocyte network.☆24Feb 15, 2023Updated 3 years ago
- Offical implementation of "Inherent Redundancy in Spiking Neural Networks" (ICCV2023)☆29Jan 7, 2024Updated 2 years ago
- ☆18Jun 26, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Deep Residual Learning in Spiking Neural Networks☆195Aug 9, 2022Updated 3 years ago
- ☆28Nov 29, 2023Updated 2 years ago
- An energy simulation framework for BPTT-based SNN inference and training.☆17Sep 6, 2023Updated 2 years ago
- Tutorial for surrogate gradient learning in spiking neural networks☆48Jul 25, 2024Updated last year
- GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networks, NeurIPS 2022 Poster☆53Feb 18, 2023Updated 3 years ago
- This is the official code repository for the paper: Towards General Continuous Memory for Vision-Language Models.☆31Jul 3, 2025Updated 11 months ago
- Scalable Neural-Probabilistic Answer Set Programming☆18May 23, 2024Updated 2 years ago
- Implementation of "SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks"☆910Jul 21, 2025Updated 11 months ago
- Multi-target compiler for Sum-Product Networks, based on MLIR and LLVM.☆25Nov 29, 2024Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- 🔥[CVPR2025] EventGPT: Event Stream Understanding with Multimodal Large Language Models☆112Jul 26, 2025Updated 11 months ago
- Joint A-SNN: Joint Training of Artificial and Spiking Neural Networks via Self-Distillation and Weight Factorization☆11Aug 1, 2023Updated 2 years ago
- Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialogue (ACL Findings 2023)☆21Nov 10, 2025Updated 7 months ago
- A paper list of spiking neural networks, including papers, codes, and related websites. 本仓库收集脉冲神经网络相关的顶会顶刊以及CNS论文和代码，正在持续更新中。☆791Mar 24, 2026Updated 3 months ago
- Real Spike: Learning Real-valued Spikes for Spiking Neural Networks☆11Jul 12, 2022Updated 3 years ago
- ☆89Feb 8, 2026Updated 4 months ago
- A curated list of materials for Spiking Neural Networks, 3rd generation of artificial neural networks.☆70Aug 19, 2022Updated 3 years ago