epoch-research / Compute-TrendsLinks
Supplementary material for our paper "Compute Trends Across Three Eras of Machine Learning".
☆40Updated 3 years ago
Alternatives and similar repositories for Compute-Trends
Users that are interested in Compute-Trends are comparing it to the libraries listed below
Sorting:
- Personal solutions to the Triton Puzzles☆18Updated 10 months ago
- A collection of reproducible inference engine benchmarks☆31Updated last month
- Make triton easier☆47Updated 11 months ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆56Updated 3 weeks ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆44Updated 10 months ago
- ☆21Updated 3 months ago
- ☆28Updated 4 months ago
- train with kittens!☆57Updated 7 months ago
- Cray-LM unified training and inference stack.☆22Updated 4 months ago
- ☆71Updated 2 months ago
- GeoT: Tensor Centric Library for Graph Neural Network via Efficient Segment Reduction on GPU☆23Updated 2 months ago
- Samples of good AI generated CUDA kernels☆73Updated last week
- PyTorch centric eager mode debugger☆47Updated 5 months ago
- FlexAttention w/ FlashAttention3 Support☆26Updated 8 months ago
- ☆26Updated last year
- ☆38Updated last year
- ChatGPT Participates in a Computer Science Exam (2023)☆31Updated 2 years ago
- ☆26Updated last year
- Using FlexAttention to compute attention with different masking patterns☆43Updated 8 months ago
- Memory Optimizations for Deep Learning (ICML 2023)☆64Updated last year
- RWKV model implementation☆38Updated last year
- Framework to reduce autotune overhead to zero for well known deployments.☆74Updated 3 weeks ago
- Write a fast kernel and run it on Discord. See how you compare against the best!☆44Updated this week
- JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)☆33Updated last year
- Experiment of using Tangent to autodiff triton☆79Updated last year
- TensorRT LLM Benchmark Configuration☆13Updated 10 months ago
- Simple repository for training small reasoning models☆31Updated 4 months ago
- Explore training for quantized models☆18Updated last week
- ☆10Updated 3 weeks ago
- Official repository of Sparse ISO-FLOP Transformations for Maximizing Training Efficiency☆25Updated 10 months ago