nod-ai / SRT
Nod.ai π¦ version of π» . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository for mainline development. This repository houses branches and configuration that aren't ready for commit upstream.
β107Updated this week
Related projects β
Alternatives and complementary repositories for SRT
- benchmarking some transformer deploymentsβ26Updated last year
- β48Updated 3 months ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mindβ¦β146Updated this week
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters iβ¦β176Updated this week
- β237Updated 3 months ago
- Training neural networks in TensorFlow 2.0 with 5x less memoryβ129Updated 2 years ago
- Customized matrix multiplication kernelsβ53Updated 2 years ago
- Unified compiler/runtime for interfacing with PyTorch Dynamo.β95Updated this week
- An experimental CPU backend for Triton (https//github.com/openai/triton)β35Updated 6 months ago
- Torch Distributed Experimentalβ116Updated 3 months ago
- β12Updated 3 years ago
- An open-source efficient deep learning framework/compiler, written in python.β652Updated last week
- The Foundation for All Legate Librariesβ193Updated last week
- A library of GPU kernels for sparse matrix operations.β249Updated 4 years ago
- Python interface for MLIR - the Multi-Level Intermediate Representationβ228Updated last month
- Home for OctoML PyTorch Profilerβ107Updated last year
- Fast sparse deep learning on CPUsβ51Updated 2 years ago
- A tracing JIT compiler for PyTorchβ12Updated 2 years ago
- Implementation of a Transformer, but completely in Tritonβ248Updated 2 years ago
- Applied AI experiments and examples for PyTorchβ168Updated 3 weeks ago
- β48Updated 8 months ago
- extensible collectives library in tritonβ72Updated 2 months ago
- β12Updated last month
- 3X speedup over Appleβs TensorFlow plugin by using Apache TVM on M1β135Updated 2 years ago
- PyTorch RFCs (experimental)β130Updated 2 months ago
- Benchmarks to capture important workloads.β28Updated 5 months ago
- Distributed preprocessing and data loading for language datasetsβ39Updated 7 months ago
- A library for syntactically rewriting Python programs, pronounced (sinner).β70Updated 2 years ago
- Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024β173Updated 7 months ago
- MatMul Performance Benchmarks for a Single CPU Core comparing both hand engineered and codegen kernels.β124Updated last year