mlcommons / inference
Reference implementations of MLPerf™ inference benchmarks
☆1,188Updated 2 weeks ago
Related projects: ⓘ
- Reference implementations of MLPerf™ training benchmarks☆1,597Updated last month
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,169Updated this week
- Representation and Reference Lowering of ONNX Models in MLIR Compiler Infrastructure☆742Updated this week
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆952Updated this week
- The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.☆1,301Updated this week
- High-efficiency floating-point neural network inference operators for mobile, server, and Web☆1,812Updated this week
- The Tensor Algebra SuperOptimizer for Deep Learning☆687Updated last year
- A performant and modular runtime for TensorFlow☆753Updated last month
- ☆392Updated this week
- Dive into Deep Learning Compiler☆640Updated 2 years ago
- BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.☆796Updated 3 weeks ago
- Low-precision matrix multiplication☆1,772Updated 7 months ago
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…☆1,811Updated this week
- Collective communications library with various primitives for multi-machine training.☆1,192Updated 2 months ago
- A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.☆692Updated this week
- Backward compatible ML compute opset inspired by HLO/MHLO☆380Updated this week
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,146Updated this week
- Quantized Neural Network PACKage - mobile-optimized implementation of quantized neural network operators☆1,518Updated 5 years ago
- Arm NN ML Software. The code here is a read-only mirror of https://review.mlplatform.org/admin/repos/ml/armnn☆1,162Updated this week
- common in-memory tensor structure☆890Updated last week
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆994Updated 5 months ago
- A retargetable MLIR-based machine learning compiler and runtime toolkit.☆2,559Updated this week
- NCCL Tests☆819Updated last month
- Actively maintained ONNX Optimizer☆634Updated 6 months ago
- TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.☆845Updated this week
- An open-source efficient deep learning framework/compiler, written in python.☆646Updated 3 weeks ago
- oneAPI Deep Neural Network Library (oneDNN)☆3,579Updated this week
- Benchmarking Deep Learning operations on different hardware☆1,065Updated 3 years ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,499Updated this week
- TensorFlow/TensorRT integration☆737Updated 9 months ago