Alternatives and similar repositories for kernel-sharing

Users that are interested in kernel-sharing are comparing it to the libraries listed below

• rlin27 / DeBut
  Codes of the paper Deformable Butterfly: A Highly Structured and Sparse Linear Transform.
  ☆16Updated 4 years ago
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆18Updated 2 years ago
• catid / dataloader
  High-performance tokenized language data-loader for Python C++ extension
  ☆14Updated last year
• EleutherAI / training-jacobian
  ☆24Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• kazuki-irie / kv-memory-brain
  Official Code Repository for the paper "Key-value memory in the brain"
  ☆31Updated 11 months ago
• graphcore-research / jax-scalify
  JAX Scalify: end-to-end scaled arithmetics
  ☆18Updated last year
• kyegomez / MobileVLM
  Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …
  ☆15Updated last year
• vineeths96 / Compressed-Transformers
  In this repository, we explore model compression for transformer architectures via quantization. We specifically explore quantization awa…
  ☆24Updated 4 years ago
• AlxSp / t-jepa
  ☆12Updated last year
• BobMcDear / flaim
  Flax Image Models - State-of-the-art pre-trained vision backbones for Flax.
  ☆23Updated 8 months ago
• FrancescoSaverioZuppichini / pytorch-2.0-benchmark
  Benchmarking PyTorch 2.0 different models
  ☆20Updated 2 years ago
• Doraemonzzz / hgru-pytorch
  ☆29Updated last year
• SmerkyG / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆12Updated 2 months ago
• herrmann / rustorch
  "PyTorch in Rust"
  ☆17Updated last year
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated 2 years ago
• hunar4321 / RLS-neural-net
  Recursive Leasting Squares (RLS) with Neural Network for fast learning
  ☆59Updated 2 years ago
• lucidrains / light-recurrent-unit-pytorch
  Implementation of a Light Recurrent Unit in Pytorch
  ☆49Updated last year
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 3 years ago
• samblouir / birdie
  ☆13Updated last month
• lucidrains / strassen-attention
  Implementation of Strassen attention, from Kozachinskiy et al. of National Center of AI in Chile
  ☆41Updated 7 months ago
• Fchaubard / gradient_agreement_filtering
  This is the official repo for Gradient Agreement Filtering (GAF).
  ☆24Updated last year
• glassroom / heinsen_attention
  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
  ☆24Updated last year
• codekansas / rwkv
  RWKV model implementation
  ☆37Updated 2 years ago
• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆22Updated 2 years ago
• lucidrains / coordinate-descent-attention
  Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
  ☆47Updated 2 years ago
• lucidrains / simplicial-attention
  Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Ro…
  ☆46Updated 5 months ago
• facebookresearch / chai
  CHAI is a library for dynamic pruning of attention heads for efficient LLM inference.
  ☆22Updated last year
• UnstoppableCurry / RWKV-LM-Interpretability-Research
  Interpretability analysis of language model outlier and attempts to distill the model
  ☆13Updated 2 years ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated last year