ridgerchu / SpikeGPT
Implementation of "SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks"
☆784Updated 2 weeks ago
Alternatives and similar repositories for SpikeGPT:
Users that are interested in SpikeGPT are comparing it to the libraries listed below
- Deep learning with spiking neural networks (SNNs) in PyTorch.☆694Updated last week
- Convolutions for Sequence Modeling☆876Updated 7 months ago
- ICLR 2023, Spikformer: When Spiking Neural Network Meets Transformer☆300Updated last year
- Spyx: Spiking Neural Networks in JAX☆109Updated 3 months ago
- Tutorial for surrogate gradient learning in spiking neural networks☆301Updated 6 months ago
- Deep and online learning with spiking neural networks in Python☆1,428Updated 5 months ago
- Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch☆403Updated 3 weeks ago
- Update arXiv papers about Spiking Neural Networks daily.☆327Updated this week
- Event datasets and transforms.☆219Updated this week
- Forward Pass Learning and Inference Library, for neural networks and general intelligence, Signal Propagation (sigprop)☆49Updated last year
- Toolbox for converting analog to spiking neural networks (ANN to SNN), and running them in a spiking neuron simulator.☆369Updated 2 years ago
- High-speed simulator of convolutional spiking neural networks with at most one spike per neuron.☆385Updated 3 years ago
- Language Modeling with the H3 State Space Model☆515Updated last year
- Offical implementation of "Spike-driven Transformer" (NeurIPS2023)☆236Updated 10 months ago
- Implementation/simulation of the predictive forward-forward credit assignment algorithm for training neurobiologically-plausible recurren…☆54Updated last year
- Efficient Spiking Neural Network framework, built on top of PyTorch for GPU acceleration☆222Updated 6 months ago
- Deep Learning library for Lava☆154Updated 2 weeks ago
- Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch☆634Updated last month
- What about coding a Spiking Neural Network using an automatic differentiation framework? In SNNs, there is a time axis and the neural net…☆266Updated 2 years ago
- Brain-inspired Cognitive Intelligence Engine (BrainCog) is a brain-inspired spiking neural network based platform for Brain-inspired Arti…☆475Updated last month
- [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization☆669Updated 5 months ago
- List of open source neuromorphic projects: SNN training frameworks, DVS handling routines and so on.☆194Updated last month
- [NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333☆1,076Updated last year
- Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.☆378Updated 7 months ago
- Mamba-Chat: A chat LLM based on the state-space model architecture 🐍☆919Updated 10 months ago
- ☆538Updated last month
- Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".☆2,006Updated 10 months ago
- Recurrent Memory Transformer☆148Updated last year
- A machine learning library for spiking neural networks. Supports training with both torch and jax pipelines, and deployment to neuromorph…☆59Updated this week
- Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm☆138Updated last year