mag- / gpu_benchmark
Gpu benchmark
☆43Updated last month
Related projects ⓘ
Alternatives and complementary repositories for gpu_benchmark
- Make triton easier☆41Updated 5 months ago
- ☆27Updated 4 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆104Updated last month
- PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu☆39Updated 2 months ago
- Collection of autoregressive model implementation☆67Updated this week
- RWKV-7: Surpassing GPT☆45Updated this week
- ☆73Updated 4 months ago
- QuIP quantization☆46Updated 8 months ago
- ☆49Updated 8 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆50Updated 7 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated 7 months ago
- A safetensors extension to efficiently store sparse quantized tensors on disk☆50Updated this week
- Experiment of using Tangent to autodiff triton☆72Updated 9 months ago
- Cerule - A Tiny Mighty Vision Model☆67Updated 2 months ago
- ☆43Updated 4 months ago
- Utilities for Training Very Large Models☆56Updated last month
- Muon optimizer for neural networks: >30% extra sample efficiency, <3% wallclock overhead☆113Updated this week
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆30Updated 3 months ago
- ☆67Updated last week
- ☆44Updated 11 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆35Updated 4 months ago
- ☆53Updated 10 months ago
- GoldFinch and other hybrid transformer components☆39Updated 4 months ago
- ring-attention experiments☆97Updated last month
- Jax like function transformation engine but micro, microjax☆26Updated 3 weeks ago
- FlexAttention w/ FlashAttention3 Support☆27Updated last month
- ☆17Updated 3 weeks ago
- An introduction to LLM Sampling☆64Updated last week
- ☆57Updated last week
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆85Updated 2 months ago