Alternatives and similar repositories for inference_policies:

Users that are interested in inference_policies are comparing it to the libraries listed below

• mlcommons / training_results_v1.0
  This repository contains the results and code for the MLPerf™ Training v1.0 benchmark.
  ☆38Updated last year
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆89Updated this week
• NVIDIA / nvtx-plugins
  Python bindings for NVTX
  ☆66Updated last year
• tbd-ai / tbd-suite
  ☆47Updated 2 years ago
• mlcommons / training_policies
  Issues related to MLPerf™ training policies, including rules and suggested changes
  ☆94Updated this week
• apache / tvm-rfcs
  A home for the final text of all TVM RFCs.
  ☆103Updated 5 months ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆61Updated this week
• NVIDIA / compute-sanitizer-samples
  Samples demonstrating how to use the Compute Sanitizer Tools and Public API
  ☆75Updated last year
• awslabs / lorien
  ☆44Updated last year
• cmu-catalyst / collage
  System for automated integration of deep learning backends.
  ☆48Updated 2 years ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆63Updated 2 years ago
• mlcommons / logging
  MLPerf™ logging library
  ☆33Updated this week
• andersy005 / tvm-in-action
  TVM stack: exploring the incredible explosion of deep-learning frameworks and how to bring them together
  ☆64Updated 6 years ago
• tlc-pack / TLCBench
  Benchmark scripts for TVM
  ☆73Updated 2 years ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆107Updated last year
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆59Updated last month
• masahi / torchscript-to-tvm
  ☆69Updated 2 years ago
• thu-pacman / PET
  PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections
  ☆119Updated 2 years ago
• saareliad / FTPipe
  FTPipe and related pipeline model parallelism research.
  ☆41Updated last year
• yalue / cuda_scheduling_examiner_mirror
  A tool for examining GPU scheduling behavior.
  ☆71Updated 6 months ago
• NVIDIA / online-softmax
  Benchmark code for the "Online normalizer calculation for softmax" paper
  ☆85Updated 6 years ago
• sunlex0717 / DissectingTensorCores
  ☆89Updated 10 months ago
• awslabs / ratex
  ☆23Updated 3 months ago
• yinuotxie / Efficient-LLM-Inferencing-on-GPUs
  Penn CIS 5650 (GPU Programming and Architecture) Final Project
  ☆29Updated last year
• ColfaxResearch / cfx-article-src
  ☆79Updated 2 weeks ago
• GVProf / GVProf
  GVProf: A Value Profiler for GPU-based Clusters
  ☆49Updated 11 months ago
• uwsampl / SparseTIR
  SparseTIR: Sparse Tensor Compiler for Deep Learning
  ☆135Updated last year
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆38Updated 2 years ago
• UofT-EcoSystem / DietCode
  DietCode Code Release
  ☆61Updated 2 years ago
• deepspeedai / DeepSpeed-Kernels
  ☆61Updated last week