epoch-research / Compute-Trends
Supplementary material for our paper "Compute Trends Across Three Eras of Machine Learning".
☆40Updated 3 years ago
Alternatives and similar repositories for Compute-Trends
Users that are interested in Compute-Trends are comparing it to the libraries listed below
Sorting:
- A collection of reproducible inference engine benchmarks☆30Updated 3 weeks ago
- Make triton easier☆47Updated 11 months ago
- Personal solutions to the Triton Puzzles☆18Updated 10 months ago
- [EMNLP 2024 Main] Virtual Personas for Language Models via an Anthology of Backstories☆26Updated 5 months ago
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆13Updated 4 months ago
- JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)☆33Updated last year
- ☆27Updated last year
- ☆47Updated 10 months ago
- Memory Optimizations for Deep Learning (ICML 2023)☆64Updated last year
- Implementation of Hyena Hierarchy in JAX☆10Updated 2 years ago
- ☆21Updated last year
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆30Updated this week
- ☆27Updated 4 months ago
- GeoT: Tensor Centric Library for Graph Neural Network via Efficient Segment Reduction on GPU☆22Updated last month
- ☆13Updated this week
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆45Updated 10 months ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆55Updated this week
- Benchmarks to capture important workloads.☆31Updated 3 months ago
- ChatGPT Participates in a Computer Science Exam (2023)☆31Updated 2 years ago
- Unit Scaling demo and experimentation code☆16Updated last year
- ☆27Updated 2 years ago
- ☆21Updated 2 months ago
- ☆18Updated last year
- ❓Curie: Automated and Rigorous Scientific Experimentation with AI Agents☆87Updated last week
- Triton Implementation of HyperAttention Algorithm☆48Updated last year
- Experiment of using Tangent to autodiff triton☆78Updated last year
- A list of awesome neural symbolic papers.☆47Updated 2 years ago
- PyTorch centric eager mode debugger☆47Updated 5 months ago
- TensorRT LLM Benchmark Configuration☆13Updated 9 months ago
- Repository to go along with the paper "Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelines"☆10Updated 3 years ago