microsoft / onnxruntime-tvmLinks
Open deep learning compiler stack for cpu, gpu and specialized accelerators
☆35Updated 3 years ago
Alternatives and similar repositories for onnxruntime-tvm
Users that are interested in onnxruntime-tvm are comparing it to the libraries listed below
Sorting:
- ☆172Updated this week
- ONNX Serving is a project written with C++ to serve onnx-mlir compiled models with GRPC and other protocols.Benefiting from C++ implement…☆25Updated 4 months ago
- ☆137Updated last week
- Self-trained Large Language Models based on Meta LLaMa☆30Updated 2 years ago
- ☆13Updated 6 years ago
- ☆68Updated 2 years ago
- Common utilities for ONNX converters☆293Updated last month
- ☆322Updated last month
- Fast sparse deep learning on CPUs☆56Updated 3 years ago
- ☆125Updated 2 years ago
- Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …☆107Updated last month
- Inference framework for MoE layers based on TensorRT with Python binding☆41Updated 4 years ago
- Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…☆37Updated 3 years ago
- AMD's graph optimization engine.☆273Updated this week
- SynapseAI Core is a reference implementation of the SynapseAI API running on Habana Gaudi☆42Updated last year
- This is a demo how to write a high performance convolution run on apple silicon☆57Updated 3 years ago
- Model compression for ONNX☆98Updated last year
- Use safetensors with ONNX 🤗☆84Updated 3 weeks ago
- Benchmarks to capture important workloads.☆32Updated 2 weeks ago
- IREE C++ Template☆17Updated last year
- TensorFlow and TVM integration☆36Updated 5 years ago
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆49Updated 5 months ago
- benchmarking some transformer deployments☆26Updated last month
- The Triton backend for the ONNX Runtime.☆172Updated this week
- XLA integration of Open Neural Network Exchange (ONNX)☆19Updated 7 years ago
- ☆22Updated 4 years ago
- Whisper in TensorRT-LLM☆17Updated 2 years ago
- Unified compiler/runtime for interfacing with PyTorch Dynamo.☆104Updated last month
- C++ implementations for various tokenizers (sentencepiece, tiktoken etc).☆47Updated last week
- how to design cpu gemm on x86 with avx256, that can beat openblas.☆73Updated 6 years ago