mag- / gpu_benchmark
Gpu benchmark
☆55Updated last month
Alternatives and similar repositories for gpu_benchmark:
Users that are interested in gpu_benchmark are comparing it to the libraries listed below
- High-Performance SGEMM on CUDA devices☆86Updated 2 months ago
- Load compute kernels from the Hub☆99Updated this week
- Experiment of using Tangent to autodiff triton☆78Updated last year
- ☆76Updated 8 months ago
- RWKV-7: Surpassing GPT☆82Updated 4 months ago
- QuIP quantization☆52Updated last year
- ☆27Updated 8 months ago
- ☆49Updated last year
- 👷 Build compute kernels☆17Updated this week
- ☆87Updated last year
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆31Updated 7 months ago
- ☆47Updated this week
- Jax like function transformation engine but micro, microjax☆30Updated 5 months ago
- research impl of Native Sparse Attention (2502.11089)☆54Updated last month
- Fast modular code to create and train cutting edge LLMs☆66Updated 10 months ago
- Focused on fast experimentation and simplicity☆69Updated 3 months ago
- ☆64Updated 2 months ago
- https://x.com/BlinkDL_AI/status/1884768989743882276☆27Updated last month
- ☆91Updated 2 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆125Updated 3 months ago
- working implimention of deepseek MLA☆38Updated 2 months ago
- Inference of Mamba models in pure C☆186Updated last year
- NanoGPT (124M) quality in 2.67B tokens☆28Updated last month
- FlexAttention w/ FlashAttention3 Support☆26Updated 5 months ago
- Here we will test various linear attention designs.☆60Updated 11 months ago
- FlashRNN - Fast RNN Kernels with I/O Awareness☆76Updated this week
- ring-attention experiments☆128Updated 5 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆54Updated 11 months ago
- Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.☆70Updated last month
- supporting pytorch FSDP for optimizers☆79Updated 3 months ago