epoch-research / Compute-TrendsLinks
Supplementary material for our paper "Compute Trends Across Three Eras of Machine Learning".
☆43Updated 3 years ago
Alternatives and similar repositories for Compute-Trends
Users that are interested in Compute-Trends are comparing it to the libraries listed below
Sorting:
- A collection of reproducible inference engine benchmarks☆37Updated 6 months ago
- Machine Learning Agility (MLAgility) benchmark and benchmarking tools☆40Updated 3 months ago
- Make triton easier☆48Updated last year
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆45Updated last year
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆13Updated 10 months ago
- Training material for IPU users: tutorials, feature examples, simple applications☆87Updated 2 years ago
- Write a fast kernel and run it on Discord. See how you compare against the best!☆58Updated 2 weeks ago
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆109Updated 3 weeks ago
- Train, tune, and infer Bamba model☆135Updated 4 months ago
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆165Updated last month
- ☆71Updated 7 months ago
- Memory Optimizations for Deep Learning (ICML 2023)☆110Updated last year
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆91Updated 2 years ago
- Example ML projects that use the Determined library.☆32Updated last year
- ☆126Updated last year
- Official repository of Sparse ISO-FLOP Transformations for Maximizing Training Efficiency☆25Updated last year
- Benchmarking PyTorch 2.0 different models☆20Updated 2 years ago
- Samples of good AI generated CUDA kernels☆91Updated 5 months ago
- Cray-LM unified training and inference stack.☆22Updated 9 months ago
- ☆28Updated 9 months ago
- ☆44Updated 6 months ago
- Compressing Large Language Models using Low Precision and Low Rank Decomposition☆104Updated 10 months ago
- train with kittens!☆63Updated last year
- Personal solutions to the Triton Puzzles☆20Updated last year
- ☆57Updated last year
- A Data-Centric Compiler for Machine Learning☆85Updated last year
- Issues related to MLPerf™ training policies, including rules and suggested changes☆95Updated last month
- ChatGPT Participates in a Computer Science Exam (2023)☆31Updated 2 years ago
- ☆112Updated last year
- Parallel framework for training and fine-tuning deep neural networks☆65Updated last week