facebookresearch / MODel_optLinks
Memory Optimizations for Deep Learning (ICML 2023)
☆64Updated last year
Alternatives and similar repositories for MODel_opt
Users that are interested in MODel_opt are comparing it to the libraries listed below
Sorting:
- extensible collectives library in triton☆86Updated 2 months ago
- ☆105Updated 9 months ago
- A Python library transfers PyTorch tensors between CPU and NVMe☆116Updated 6 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆136Updated this week
- ☆63Updated this week
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆90Updated 2 weeks ago
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆138Updated 2 years ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆109Updated 11 months ago
- ☆81Updated 7 months ago
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆65Updated 3 years ago
- ☆157Updated last year
- Benchmark code for the "Online normalizer calculation for softmax" paper☆94Updated 6 years ago
- Complete GPU residency for ML.☆17Updated last week
- PyTorch bindings for CUTLASS grouped GEMM.☆99Updated 3 weeks ago
- ☆72Updated 2 months ago
- ☆50Updated last year
- ☆147Updated 11 months ago
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆166Updated this week
- JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training☆49Updated last month
- ☆75Updated 5 months ago
- Training neural networks in TensorFlow 2.0 with 5x less memory☆131Updated 3 years ago
- GEMM and Winograd based convolutions using CUTLASS☆26Updated 4 years ago
- Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.☆67Updated 3 months ago
- ☆36Updated 6 months ago
- A schedule language for large model training☆149Updated last year
- DeeperGEMM: crazy optimized version☆69Updated last month
- llama INT4 cuda inference with AWQ☆54Updated 5 months ago
- PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.☆110Updated 6 months ago
- Collection of kernels written in Triton language☆132Updated 2 months ago
- (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.☆39Updated 2 years ago