ridgerchu / SpikeGPT
Implementation of "SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks"
☆798Updated 2 months ago
Alternatives and similar repositories for SpikeGPT:
Users that are interested in SpikeGPT are comparing it to the libraries listed below
- Deep learning with spiking neural networks (SNNs) in PyTorch.☆713Updated 3 weeks ago
- ICLR 2023, Spikformer: When Spiking Neural Network Meets Transformer☆317Updated last year
- High-speed simulator of convolutional spiking neural networks with at most one spike per neuron.☆383Updated 3 years ago
- Convolutions for Sequence Modeling☆878Updated 9 months ago
- Deep and online learning with spiking neural networks in Python☆1,512Updated last month
- Update arXiv papers about Spiking Neural Networks daily.☆354Updated this week
- Brain-inspired Cognitive Intelligence Engine (BrainCog) is a brain-inspired spiking neural network based platform for Brain-inspired Arti…☆501Updated 2 weeks ago
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways☆820Updated 2 years ago
- Language Modeling with the H3 State Space Model☆517Updated last year
- Tutorial for surrogate gradient learning in spiking neural networks☆309Updated 8 months ago
- Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate …☆633Updated last year
- Toolbox for converting analog to spiking neural networks (ANN to SNN), and running them in a spiking neuron simulator.☆374Updated 2 years ago
- What about coding a Spiking Neural Network using an automatic differentiation framework? In SNNs, there is a time axis and the neural net…☆266Updated 2 years ago
- Event datasets and transforms.☆235Updated last month
- Forward Pass Learning and Inference Library, for neural networks and general intelligence, Signal Propagation (sigprop)☆52Updated 2 years ago
- The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”☆955Updated last year
- ☆254Updated 2 years ago
- ☆543Updated 3 months ago
- List of open source neuromorphic projects: SNN training frameworks, DVS handling routines and so on.☆214Updated 4 months ago
- Efficient Spiking Neural Network framework, built on top of PyTorch for GPU acceleration☆224Updated 8 months ago
- Offical implementation of "Spike-driven Transformer" (NeurIPS2023)☆243Updated last year
- [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization☆683Updated 7 months ago
- ☆535Updated last year
- Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.☆381Updated 9 months ago
- Huggingface compatible implementation of RetNet (Retentive Networks, https://arxiv.org/pdf/2307.08621.pdf) including parallel, recurrent,…☆225Updated last year
- Deep Learning library for Lava☆157Updated last week
- Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"☆549Updated 3 months ago
- 🔥🔥🔥A collection of some awesome public SNN(Spiking Neural Network) projects.☆180Updated 6 months ago
- Spyx: Spiking Neural Networks in JAX☆112Updated 5 months ago
- SpikingJelly is an open-source deep learning framework for Spiking Neural Network (SNN) based on PyTorch.☆1,526Updated 2 months ago