nod-ai / transformer-benchmarks
benchmarking some transformer deployments
☆26Updated last year
Related projects ⓘ
Alternatives and complementary repositories for transformer-benchmarks
- Benchmarks to capture important workloads.☆28Updated 5 months ago
- A tracing JIT compiler for PyTorch☆12Updated 2 years ago
- Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …☆107Updated this week
- ☆55Updated 5 months ago
- MLPerf™ logging library☆30Updated last week
- Fast sparse deep learning on CPUs☆51Updated 2 years ago
- ☆48Updated 8 months ago
- Home for OctoML PyTorch Profiler☆107Updated last year
- A library for syntactically rewriting Python programs, pronounced (sinner).☆70Updated 2 years ago
- A Python library transfers PyTorch tensors between CPU and NVMe☆98Updated last week
- Personal collection of references for high performance mixed precision training.☆41Updated 5 years ago
- ☆11Updated 3 years ago
- Use tensor core to calculate back-to-back HGEMM (half-precision general matrix multiplication) with MMA PTX instruction.☆11Updated last year
- Notes and artifacts from the ONNX steering committee☆25Updated last week
- ☆48Updated 3 months ago
- Memory Optimizations for Deep Learning (ICML 2023)☆60Updated 8 months ago
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆63Updated 2 years ago
- Distributed ML Optimizer☆30Updated 3 years ago
- ☆16Updated 7 months ago
- Prototype routines for GPU quantization written using PyTorch.☆19Updated last week
- ☆12Updated last month
- Customized matrix multiplication kernels☆53Updated 2 years ago
- ☆14Updated last month
- ☆67Updated last year
- Inference framework for MoE layers based on TensorRT with Python binding☆41Updated 3 years ago
- Research and development for optimizing transformers☆125Updated 3 years ago
- Torch Distributed Experimental☆116Updated 3 months ago
- Benchmarking PyTorch 2.0 different models☆21Updated last year
- Development repository for integrating FlexFlow (A distributed deep learning framework that supports flexible parallelization strategies)…☆28Updated 3 years ago