Alternatives and similar repositories for kernel-sharing

Users that are interested in kernel-sharing are comparing it to the libraries listed below

• graphcore-research / jax-scalify
  JAX Scalify: end-to-end scaled arithmetics
  ☆17Updated last year
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated 2 years ago
• kazuki-irie / kv-memory-brain
  Official Code Repository for the paper "Key-value memory in the brain"
  ☆31Updated 10 months ago
• catid / dataloader
  High-performance tokenized language data-loader for Python C++ extension
  ☆14Updated last year
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆27Updated 2 years ago
• davisyoshida / abnormal-floats
  Code for the note "NF4 Isn't Information Theoretically Optimal (and that's Good)
  ☆21Updated 2 years ago
• NolanoOrg / SpectraSuite
  ☆52Updated last year
• AlxSp / t-jepa
  ☆12Updated last year
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆18Updated 2 years ago
• rlin27 / DeBut
  Codes of the paper Deformable Butterfly: A Highly Structured and Sparse Linear Transform.
  ☆13Updated 4 years ago
• SmerkyG / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆12Updated last month
• lucidrains / light-recurrent-unit-pytorch
  Implementation of a Light Recurrent Unit in Pytorch
  ☆49Updated last year
• EleutherAI / training-jacobian
  ☆24Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• nreHieW / loss
  Visualising Losses in Deep Neural Networks
  ☆16Updated last year
• kyegomez / MobileVLM
  Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …
  ☆15Updated last year
• BobMcDear / flaim
  Flax Image Models - State-of-the-art pre-trained vision backbones for Flax.
  ☆23Updated 7 months ago
• samblouir / birdie
  ☆13Updated 3 weeks ago
• zhiyuan1i / TorchRWKV
  RWKV6 in native pytorch and triton:)
  ☆11Updated last year
• FrancescoSaverioZuppichini / pytorch-2.0-benchmark
  Benchmarking PyTorch 2.0 different models
  ☆20Updated 2 years ago
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆55Updated 9 months ago
• glassroom / heinsen_attention
  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
  ☆24Updated last year
• lucidrains / simplicial-attention
  Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Ro…
  ☆46Updated 4 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated last year
• jquesnelle / ctranslate2-rs
  Rust bindings for CTranslate2
  ☆14Updated 2 years ago
• gordicaleksa / OpenGemini
  Effort to open-source 10.5 trillion parameter Gemini model.
  ☆17Updated 2 years ago
• Z-T-WANG / LaProp-Optimizer
  Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"
  ☆29Updated 5 years ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆29Updated 2 months ago
• UnstoppableCurry / RWKV-LM-Interpretability-Research
  Interpretability analysis of language model outlier and attempts to distill the model
  ☆13Updated 2 years ago
• ChristophReich1996 / HyperMixer
  PyTorch reimplementation of the paper "HyperMixer: An MLP-based Green AI Alternative to Transformers" [arXiv 2022].
  ☆18Updated 3 years ago