Alternatives and similar repositories for kernel-sharing

Users that are interested in kernel-sharing are comparing it to the libraries listed below

• graphcore-research / jax-scalify
  JAX Scalify: end-to-end scaled arithmetics
  ☆16Updated 9 months ago
• rlin27 / DeBut
  Codes of the paper Deformable Butterfly: A Highly Structured and Sparse Linear Transform.
  ☆12Updated 3 years ago
• catid / dataloader
  High-performance tokenized language data-loader for Python C++ extension
  ☆13Updated last year
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆18Updated last year
• EleutherAI / training-jacobian
  ☆23Updated 8 months ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆25Updated 6 months ago
• kazuki-irie / kv-memory-brain
  Official Code Repository for the paper "Key-value memory in the brain"
  ☆27Updated 5 months ago
• glassroom / heinsen_attention
  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
  ☆24Updated last year
• zhiyuan1i / TorchRWKV
  RWKV6 in native pytorch and triton:)
  ☆11Updated last year
• kyegomez / MobileVLM
  Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …
  ☆16Updated last year
• AlxSp / t-jepa
  ☆11Updated last year
• crypdick / timm-lr-scheduler-explorer
  A dashboard for exploring timm learning rate schedulers
  ☆19Updated 8 months ago
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated 2 years ago
• codekansas / rwkv
  RWKV model implementation
  ☆38Updated 2 years ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated 2 years ago
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆53Updated 4 months ago
• samblouir / birdie
  ☆13Updated 2 months ago
• BlinkDL / WorldModel
  Let us make Psychohistory (as in Asimov) a reality, and accessible to everyone. Useful for LLM grounding and games / fiction / business /…
  ☆40Updated 2 years ago
• theAdamColton / ijepa-enhanced
  recipe for training fully-featured self supervised image jepa models
  ☆10Updated 2 months ago
• facebookresearch / chai
  CHAI is a library for dynamic pruning of attention heads for efficient LLM inference.
  ☆17Updated 8 months ago
• jquesnelle / ctranslate2-rs
  Rust bindings for CTranslate2
  ☆14Updated 2 years ago
• zaydzuhri / flame
  Fork of Flame repo for training of some new stuff in development
  ☆14Updated 3 weeks ago
• Z-T-WANG / LaProp-Optimizer
  Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"
  ☆29Updated 5 years ago
• lucidrains / strassen-attention
  Implementation of Strassen attention, from Kozachinskiy et al. of National Center of AI in Chile
  ☆41Updated last month
• acosharma / elita-transformer
  Official Repository for Efficient Linear-Time Attention Transformers.
  ☆18Updated last year
• lucidrains / simplicial-attention
  Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Ro…
  ☆43Updated 3 weeks ago
• kyegomez / SoundStream
  Implementation of SoundtStream from the paper: "SoundStream: An End-to-End Neural Audio Codec"
  ☆12Updated 6 months ago
• ChristophReich1996 / HyperMixer
  PyTorch reimplementation of the paper "HyperMixer: An MLP-based Green AI Alternative to Transformers" [arXiv 2022].
  ☆17Updated 3 years ago
• BobMcDear / flaim
  Flax Image Models - State-of-the-art pre-trained vision backbones for Flax.
  ☆20Updated 2 months ago