Kernel-Machines / kermacLinks
Pytorch routines for (Ker)nel (Mac)hines
☆10Updated 3 months ago
Alternatives and similar repositories for kermac
Users that are interested in kermac are comparing it to the libraries listed below
Sorting:
- Personal solutions to the Triton Puzzles☆20Updated last year
- A bunch of kernels that might make stuff slower 😉☆75Updated this week
- Experiment of using Tangent to autodiff triton☆81Updated 2 years ago
- Code for the paper: https://arxiv.org/pdf/2309.06979.pdf☆21Updated last year
- ☆28Updated last year
- Write a fast kernel and run it on Discord. See how you compare against the best!☆67Updated this week
- Sparsity support for PyTorch☆38Updated 10 months ago
- Make triton easier☆50Updated last year
- Custom triton kernels for training Karpathy's nanoGPT.☆19Updated last year
- Ship correct and fast LLM kernels to PyTorch☆135Updated last week
- ☆18Updated 2 months ago
- ☆40Updated 2 years ago
- extensible collectives library in triton☆93Updated 9 months ago
- Automatic differentiation for Triton Kernels☆29Updated 5 months ago
- ☆12Updated 4 months ago
- train with kittens!☆63Updated last year
- ☆33Updated last year
- Supporting code for the blog post on modular manifolds.☆110Updated 3 months ago
- Distributed pretraining of large language models (LLMs) on cloud TPU slices, with Jax and Equinox.☆24Updated last year
- JAX implementation of the Mistral 7b v0.2 model☆35Updated last year
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆79Updated 3 weeks ago
- ☆23Updated 8 months ago
- ☆127Updated this week
- ring-attention experiments☆161Updated last year
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)☆98Updated last year
- Triton-based Symmetric Memory operators and examples☆79Updated last week
- Minimal but scalable implementation of large language models in JAX☆35Updated last month
- Collection of kernels written in Triton language☆174Updated 9 months ago
- ☆27Updated 2 years ago
- Parallel framework for training and fine-tuning deep neural networks☆70Updated 2 months ago