Alternatives and similar repositories for RzLinear

Users that are interested in RzLinear are comparing it to the libraries listed below

• apd10 / universal_memory_allocation
  ☆15Updated 3 years ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆64Updated last year
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆44Updated 10 months ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆54Updated 3 years ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆18Updated this week
• marsupialtail / sparsednn
  Fast sparse deep learning on CPUs
  ☆53Updated 2 years ago
• sustcsonglin / gated_linear_attention_layer
  ☆32Updated last year
• spcl / substation
  Research and development for optimizing transformers
  ☆126Updated 4 years ago
• VITA-Group / Structure-LTH
  [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…
  ☆33Updated 2 years ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆109Updated 10 months ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆51Updated 2 years ago
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆47Updated 5 months ago
• stanford-futuredata / stk
  ☆105Updated 9 months ago
• thecharlieblake / lovely-llama
  An implementation of the Llama architecture, to instruct and delight
  ☆21Updated this week
• tridao / flash-attention-wheels
  ☆49Updated last year
• cchan / tccl
  extensible collectives library in triton
  ☆87Updated 2 months ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆44Updated 2 years ago
• davisyoshida / abnormal-floats
  Code for the note "NF4 Isn't Information Theoretically Optimal (and that's Good)
  ☆19Updated last year
• codekansas / rwkv
  RWKV model implementation
  ☆38Updated last year
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated 8 months ago
• topal-team / rockmate
  ☆36Updated 5 months ago
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆157Updated 6 months ago
• DS3Lab / CocktailSGD
  ☆26Updated last year
• lianakoleva / no-libtorch-compile
  ☆21Updated 3 months ago
• lucidrains / mlp-gpt-jax
  A GPT, made only of MLPs, in Jax
  ☆58Updated 3 years ago
• glassroom / heinsen_attention
  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
  ☆24Updated last year
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆52Updated last year
• FrancescoSaverioZuppichini / pytorch-2.0-benchmark
  Benchmarking PyTorch 2.0 different models
  ☆21Updated 2 years ago