apd10 / RzLinear

Related projects ⓘ

Alternatives and complementary repositories for RzLinear

• apd10 / universal_memory_allocation
  ☆15Updated 2 years ago
• alexzhang13 / Triton-Puzzles-Solutions
  Personal solutions to the Triton Puzzles
  ☆16Updated 4 months ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆60Updated 8 months ago
• huyz2023 / 2by4-pretrain
  Efficient 2:4 sparse training algorithms and implementations
  ☆21Updated 5 months ago
• ptillet / triton-llvm-releases
  ☆20Updated last year
• glassroom / heinsen_attention
  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
  ☆24Updated 5 months ago
• emalach / LinearLM
  Code for the paper: https://arxiv.org/pdf/2309.06979.pdf
  ☆16Updated 3 months ago
• tensorpro / tpu_rwkv
  JAX implementations of RWKV
  ☆19Updated last year
• cchan / tccl
  extensible collectives library in triton
  ☆72Updated last month
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆72Updated 10 months ago
• davisyoshida / abnormal-floats
  Code for the note "NF4 Isn't Information Theoretically Optimal (and that's Good)
  ☆18Updated last year
• graphcore-research / unit-scaling-demo
  Unit Scaling demo and experimentation code
  ☆16Updated 8 months ago
• yifuwang / symm-mem-recipes
  ☆12Updated last month
• Doraemonzzz / nanoTransNormer
  ☆11Updated last year
• sustcsonglin / gated_linear_attention_layer
  ☆31Updated 10 months ago
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆19Updated this week
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated last year
• topal-team / rockmate
  ☆33Updated last year
• DS3Lab / CocktailSGD
  ☆24Updated last year
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆20Updated last week
• RobertCsordas / moe_layer
  sigma-MoE layer
  ☆18Updated 10 months ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆35Updated 4 months ago
• Aleph-Alpha / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated 11 months ago
• triton-lang / kernels
  ☆45Updated 2 weeks ago
• BlinkDL / SmallInitEmb
  LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
  ☆45Updated 2 years ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆90Updated 4 months ago
• facebookexperimental / protoquant
  Prototype routines for GPU quantization written using PyTorch.
  ☆19Updated last week
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last month
• Doraemonzzz / hgru2-pytorch
  ☆21Updated last month