Alternatives and similar repositories for kermac

Users that are interested in kermac are comparing it to the libraries listed below

• alexzhang13 / Triton-Puzzles-Solutions
  Personal solutions to the Triton Puzzles
  ☆20Updated last year
• open-lm-engine / accelerated-model-architectures
  A bunch of kernels that might make stuff slower 😉
  ☆75Updated this week
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆81Updated 2 years ago
• emalach / LinearLM
  Code for the paper: https://arxiv.org/pdf/2309.06979.pdf
  ☆21Updated last year
• Jokeren / triton-samples
  ☆28Updated last year
• gpu-mode / kernelbot
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆67Updated this week
• spcl / sten
  Sparsity support for PyTorch
  ☆38Updated 10 months ago
• UmerHA / triton_util
  Make triton easier
  ☆50Updated last year
• Jaykef / Triton-nanoGPT
  Custom triton kernels for training Karpathy's nanoGPT.
  ☆19Updated last year
• meta-pytorch / BackendBench
  Ship correct and fast LLM kernels to PyTorch
  ☆135Updated last week
• IaroslavElistratov / triton-autodiff
  ☆18Updated 2 months ago
• johnryan465 / pscan
  ☆40Updated 2 years ago
• cchan / tccl
  extensible collectives library in triton
  ☆93Updated 9 months ago
• daniel-geon-park / triton_bwd
  Automatic differentiation for Triton Kernels
  ☆29Updated 5 months ago
• malfet / llm_experiments
  ☆12Updated 4 months ago
• HazyResearch / train-tk
  train with kittens!
  ☆63Updated last year
• AndPotap / einsum-search
  ☆33Updated last year
• thinking-machines-lab / manifolds
  Supporting code for the blog post on modular manifolds.
  ☆110Updated 3 months ago
• AllanYangZhou / midGPT
  Distributed pretraining of large language models (LLMs) on cloud TPU slices, with Jax and Equinox.
  ☆24Updated last year
• yixiaoer / mistral-v0.2-jax
  JAX implementation of the Mistral 7b v0.2 model
  ☆35Updated last year
• hao-ai-lab / DistCA
  Efficient Long-context Language Model Training by Core Attention Disaggregation
  ☆79Updated 3 weeks ago
• Dao-AILab / gemm-cublas
  ☆23Updated 8 months ago
• NVIDIA-NeMo / Emerging-Optimizers
  ☆127Updated this week
• gpu-mode / ring-attention
  ring-attention experiments
  ☆161Updated last year
• glassroom / heinsen_sequence
  Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)
  ☆98Updated last year
• meta-pytorch / kraken
  Triton-based Symmetric Memory operators and examples
  ☆79Updated last week
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆35Updated last month
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆174Updated 9 months ago
• DS3Lab / CocktailSGD
  ☆27Updated 2 years ago
• axonn-ai / axonn
  Parallel framework for training and fine-tuning deep neural networks
  ☆70Updated 2 months ago