epoch-research / Compute-TrendsLinks
Supplementary material for our paper "Compute Trends Across Three Eras of Machine Learning".
☆43Updated 3 years ago
Alternatives and similar repositories for Compute-Trends
Users that are interested in Compute-Trends are comparing it to the libraries listed below
Sorting:
- A collection of reproducible inference engine benchmarks☆34Updated 5 months ago
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆13Updated 9 months ago
- Make triton easier☆47Updated last year
- Machine Learning Agility (MLAgility) benchmark and benchmarking tools☆40Updated 2 months ago
- ☆38Updated 2 years ago
- Training material for IPU users: tutorials, feature examples, simple applications☆87Updated 2 years ago
- Memory Optimizations for Deep Learning (ICML 2023)☆108Updated last year
- Write a fast kernel and run it on Discord. See how you compare against the best!☆58Updated 2 weeks ago
- ML model training for edge devices☆168Updated 2 years ago
- ☆125Updated last year
- Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)☆105Updated 2 years ago
- Parallel framework for training and fine-tuning deep neural networks☆65Updated 6 months ago
- Example ML projects that use the Determined library.☆32Updated last year
- Home for OctoML PyTorch Profiler☆114Updated 2 years ago
- train with kittens!☆62Updated 11 months ago
- Official repository of Sparse ISO-FLOP Transformations for Maximizing Training Efficiency☆25Updated last year
- Benchmarking PyTorch 2.0 different models☆20Updated 2 years ago
- PyTorch centric eager mode debugger☆48Updated 9 months ago
- ChatGPT Participates in a Computer Science Exam (2023)☆31Updated 2 years ago
- NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference☆68Updated 10 months ago
- ☆72Updated 6 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆45Updated last year
- Torch Distributed Experimental☆117Updated last year
- A list of awesome neural symbolic papers.☆48Updated 3 years ago
- ☆28Updated 8 months ago
- Cray-LM unified training and inference stack.☆22Updated 8 months ago
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆92Updated 2 years ago
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆73Updated last year
- Issues related to MLPerf™ training policies, including rules and suggested changes☆95Updated 2 weeks ago
- ☆113Updated last year