AlirezaAzadbakht / kernel-sharingLinks
Drastically Reducing the Number of Trainable Parameters in Deep CNNs by Inter-layer Kernel-sharing
☆13Updated 2 years ago
Alternatives and similar repositories for kernel-sharing
Users that are interested in kernel-sharing are comparing it to the libraries listed below
Sorting:
- JAX Scalify: end-to-end scaled arithmetics☆17Updated last year
- Codes of the paper Deformable Butterfly: A Highly Structured and Sparse Linear Transform.☆13Updated 4 years ago
- High-performance tokenized language data-loader for Python C++ extension☆14Updated last year
- Recursive Leasting Squares (RLS) with Neural Network for fast learning☆58Updated 2 years ago
- Implementation of a holodeck, written in Pytorch☆18Updated 2 years ago
- Visualising Losses in Deep Neural Networks☆16Updated last year
- ☆24Updated last year
- ☆11Updated last year
- A dashboard for exploring timm learning rate schedulers☆19Updated last year
- Official Code Repository for the paper "Key-value memory in the brain"☆31Updated 9 months ago
- Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Ro…☆46Updated 3 months ago
- Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)☆55Updated 8 months ago
- Rust bindings for CTranslate2☆14Updated 2 years ago
- JAX implementations of RWKV☆19Updated 2 years ago
- Flax Image Models - State-of-the-art pre-trained vision backbones for Flax.☆23Updated 6 months ago
- Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012☆49Updated 3 years ago
- Implementation of Strassen attention, from Kozachinskiy et al. of National Center of AI in Chile☆41Updated 5 months ago
- Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"☆29Updated 5 years ago
- Implementation of Hyena Hierarchy in JAX☆10Updated 2 years ago
- Toy genetic algorithm in Pytorch☆54Updated 7 months ago
- "PyTorch in Rust"☆17Updated last year
- GoldFinch and other hybrid transformer components☆12Updated last week
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆15Updated last year
- Trying to deconstruct RWKV in understandable terms☆14Updated 2 years ago
- In this repository, we explore model compression for transformer architectures via quantization. We specifically explore quantization awa…☆24Updated 4 years ago
- ☆52Updated last year
- This repository contains the code for the paper "TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back)…☆12Updated 9 months ago
- HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]☆14Updated 2 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- ☆54Updated 3 years ago