gevtushenko / llm.c
LLM training in simple, raw C/CUDA
☆86Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for llm.c
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆34Updated 5 months ago
- ☆140Updated this week
- ring-attention experiments☆95Updated 3 weeks ago
- extensible collectives library in triton☆61Updated last month
- Simple and fast low-bit matmul kernels in CUDA / Triton☆133Updated this week
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆95Updated last year
- Attention in SRAM on Tenstorrent Grayskull☆29Updated 3 months ago
- Cataloging released Triton kernels.☆132Updated 2 months ago
- A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.☆98Updated last month
- Applied AI experiments and examples for PyTorch☆159Updated last week
- Fast Matrix Multiplications for Lookup Table-Quantized LLMs☆183Updated last month
- ☆96Updated last month
- Fast, Multi-threaded Matrix Multiplication in C☆178Updated 3 weeks ago
- Learning about CUDA by writing PTX code.☆28Updated 8 months ago
- A stand-alone implementation of several NumPy dtype extensions used in machine learning.☆208Updated this week
- Make triton easier☆41Updated 4 months ago
- Explore training for quantized models☆10Updated 2 weeks ago
- Collection of kernels written in Triton language☆63Updated last week
- ☆43Updated this week
- Triton implementation of GPT/LLAMA☆15Updated 2 months ago
- An experimental CPU backend for Triton☆55Updated last week
- FlexAttention w/ FlashAttention3 Support☆26Updated last month
- ☆55Updated 5 months ago
- This repository contains the experimental PyTorch native float8 training UX☆211Updated 3 months ago
- ☆17Updated 2 weeks ago
- ☆133Updated 9 months ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆87Updated 3 months ago
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆157Updated last year
- ☆162Updated 3 months ago
- Gpu benchmark☆43Updated last month