This is the implentation of our paper "SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms" in ICML 2024.
☆42Jul 9, 2024Updated last year
Alternatives and similar repositories for SpikeLM
Users that are interested in SpikeLM are comparing it to the libraries listed below
Sorting:
- This is the implentation of our paper "SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking" i…☆44Mar 2, 2025Updated last year
- This project contains code for the paper titled "SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentia…☆28Feb 21, 2024Updated 2 years ago
- [Neural Networks] SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation☆26Apr 11, 2025Updated 11 months ago
- Offical implementation of "Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation …☆220May 10, 2024Updated last year
- ☆23Jan 27, 2026Updated last month
- Spiking Global-Local Fusion Transformer☆21Apr 27, 2025Updated 10 months ago
- Minimal PyTorch implementation of TP, SP, FSDP and sharded-EMA☆32Nov 27, 2025Updated 3 months ago
- Ternary Spike: Learning Ternary Spikes for Spiking Neural Networks☆27Dec 14, 2023Updated 2 years ago
- The 1st Spiking Transformer Benchmark (NeurIPS 2025)☆19Dec 29, 2025Updated 2 months ago
- Pytorch implementation of Spiking Neural Networks for Human Activity Recognition.☆20Dec 11, 2022Updated 3 years ago
- Offical implementation of "Spike-driven Transformer" (NeurIPS2023)☆304Mar 18, 2024Updated 2 years ago
- Create a new backward path for more accurate SNN gradients.☆17Aug 19, 2024Updated last year
- ☆16Feb 22, 2024Updated 2 years ago
- [NeurIPS 2024] Spiking Graph Neural Networks on Riemannian Manifolds☆21Oct 22, 2024Updated last year
- Membrane Potential Batch Normalization for Spiking Neural Networks☆20Aug 18, 2023Updated 2 years ago
- Offical implementation of "Temporal-wise Attention Spiking Neural Networks for Event Streams Classification" (ICCV2021)☆23Oct 16, 2023Updated 2 years ago
- ☆53Dec 2, 2023Updated 2 years ago
- [ICLR 2024] Official implementation of Spiking Graph Contrastive Learning (0️⃣1️⃣ SpikeGCL)☆33May 8, 2024Updated last year
- Offical implementation of "Quantized Spike-driven Transformer" (ICLR2025)☆34Dec 23, 2025Updated 3 months ago
- Based on BrainTransformers, BrainGPTForCausalLM is a Large Language Model (LLM) implemented using Spiking Neural Networks (SNN). We are e…☆32Oct 22, 2024Updated last year
- [ICCV2023] Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks☆45Aug 2, 2023Updated 2 years ago
- Spikingformer: A Key Foundation Model for Spiking Neural Networks (AAAI 2026)☆128Nov 21, 2025Updated 4 months ago
- Two self-contained notebooks to perform "weight transformer" from pretrained Transformer model to neuron-astrocyte network.☆24Feb 15, 2023Updated 3 years ago
- A paper list of spiking neural networks, including papers, codes, and related websites. 本仓库收集脉冲神经网络相关的顶会顶刊以及CNS论文和代码，正在持续更新中。☆723Jan 28, 2026Updated last month
- Tutorial for surrogate gradient learning in spiking neural networks☆48Jul 25, 2024Updated last year
- Scalable Computation of Hessian Diagonals☆14Jun 2, 2024Updated last year
- ☆85Feb 8, 2026Updated last month
- ICLR 2023, Spikformer: When Spiking Neural Network Meets Transformer☆395Jan 23, 2024Updated 2 years ago
- RISC-V-based many-core neuromorphic architecture☆16Aug 3, 2025Updated 7 months ago
- Rest API client for Trading212☆20Nov 14, 2024Updated last year
- A curated list of materials for Spiking Neural Networks, 3rd generation of artificial neural networks.☆69Aug 19, 2022Updated 3 years ago
- ☆19Sep 29, 2025Updated 5 months ago
- 本项目为北航自然语言处理课程2020秋季学年大作业☆10Dec 28, 2020Updated 5 years ago
- An example Hardware Processing Engine☆12Feb 4, 2023Updated 3 years ago
- Implementation for "Surrogate Losses for Online Learning of Stepsizes in Stochastic Non-Convex Optimization"☆10Aug 3, 2022Updated 3 years ago
- Real Spike: Learning Real-valued Spikes for Spiking Neural Networks☆11Jul 12, 2022Updated 3 years ago
- [ICML 2023] This project is the official implementation of our accepted ICML 2023 paper BiBench: Benchmarking and Analyzing Network Binar…☆56Mar 4, 2024Updated 2 years ago
- ☆13Jun 2, 2023Updated 2 years ago
- built Memristor model and simulated learning circuit with python☆13Apr 11, 2022Updated 3 years ago