facebookresearch / MODel_optLinks
Memory Optimizations for Deep Learning (ICML 2023)
☆110Updated last year
Alternatives and similar repositories for MODel_opt
Users that are interested in MODel_opt are comparing it to the libraries listed below
Sorting:
- extensible collectives library in triton☆91Updated 7 months ago
- ☆113Updated last year
- Collection of kernels written in Triton language☆164Updated 7 months ago
- This repository contains the experimental PyTorch native float8 training UX☆223Updated last year
- Fast low-bit matmul kernels in Triton☆395Updated 3 weeks ago
- Write a fast kernel and run it on Discord. See how you compare against the best!☆61Updated this week
- JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training☆57Updated last month
- ☆158Updated 2 years ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆161Updated last month
- How to ensure correctness and ship LLM generated kernels in PyTorch☆117Updated this week
- A Python library transfers PyTorch tensors between CPU and NVMe☆121Updated 11 months ago
- Cataloging released Triton kernels.☆267Updated 2 months ago
- A bunch of kernels that might make stuff slower 😉☆64Updated last week
- ring-attention experiments☆155Updated last year
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆282Updated this week
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆216Updated this week
- ☆337Updated last week
- Applied AI experiments and examples for PyTorch☆303Updated 2 months ago
- A block oriented training approach for inference time optimization.☆33Updated last year
- ☆247Updated this week
- Parallel framework for training and fine-tuning deep neural networks☆68Updated last week
- Fast Hadamard transform in CUDA, with a PyTorch interface☆257Updated 3 weeks ago
- ☆93Updated last year
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆620Updated this week
- ☆181Updated last year
- ☆71Updated 7 months ago
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆47Updated 2 months ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆121Updated last year
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆100Updated 4 months ago
- ☆28Updated 10 months ago