nod-ai / transformer-benchmarksLinks
benchmarking some transformer deployments
β26Updated 2 years ago
Alternatives and similar repositories for transformer-benchmarks
Users that are interested in transformer-benchmarks are comparing it to the libraries listed below
Sorting:
- Benchmarks to capture important workloads.β31Updated 4 months ago
- Nod.ai π¦ version of π» . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository β¦β106Updated 4 months ago
- A tracing JIT compiler for PyTorchβ13Updated 3 years ago
- A collection of reproducible inference engine benchmarksβ31Updated last month
- β13Updated 4 years ago
- Make triton easierβ47Updated 11 months ago
- Home for OctoML PyTorch Profilerβ113Updated 2 years ago
- Tutorial on how to convert machine learned models into ONNXβ16Updated 2 years ago
- Distributed ML Optimizerβ32Updated 3 years ago
- β28Updated 4 months ago
- JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM trainingβ45Updated 2 weeks ago
- β50Updated last year
- MLPerfβ’ logging libraryβ36Updated last month
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large β¦β65Updated 3 years ago
- Distributed preprocessing and data loading for language datasetsβ39Updated last year
- Notes and artifacts from the ONNX steering committeeβ26Updated last week
- β71Updated 2 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.β44Updated 10 months ago
- A Python library transfers PyTorch tensors between CPU and NVMeβ116Updated 6 months ago
- A place to store reusable transformer components of my own creation or found on the interwebsβ56Updated 3 weeks ago
- Torch Distributed Experimentalβ117Updated 10 months ago
- PyTorch RFCs (experimental)β132Updated last week
- Fast sparse deep learning on CPUsβ53Updated 2 years ago
- Implementation of a Tensorflow XLA rematerialization passβ15Updated 5 years ago
- Standalone commandline CLI tool for compiling Triton kernelsβ18Updated 8 months ago
- π Interactive performance profiling and debugging tool for PyTorch neural networks.β61Updated 4 months ago
- β40Updated 5 months ago
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters iβ¦β179Updated 5 months ago
- Ahead of Time (AOT) Triton Math Libraryβ64Updated last week
- β52Updated 9 months ago