leimao / Simple-Inference-Server

Related projects: ⓘ

• mcarilli / mixed_precision_references
  Personal collection of references for high performance mixed precision training.
  ☆41Updated 4 years ago
• leimao / LibTorch-ResNet-CIFAR
  ResNet Implementation, Training, and Inference Using LibTorch C++ API
  ☆34Updated 3 months ago
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated last year
• marsupialtail / sparsednn
  Fast sparse deep learning on CPUs
  ☆51Updated last year
• adityaiitb / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆22Updated 2 years ago
• adityaiitb / pyprof2
  PyProf2: PyTorch Profiling tool
  ☆83Updated 4 years ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆53Updated 2 years ago
• csukuangfj / OpenCNN
  An Open Convolutional Neural Network Framework in C++ From Scratch
  ☆57Updated 3 years ago
• torchexpo / torchexpo
  Collection of models and extensions for deployment in PyTorch
  ☆24Updated last year
• FrancescoSaverioZuppichini / pytorch-2.0-benchmark
  Benchmarking PyTorch 2.0 different models
  ☆20Updated last year
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆83Updated 11 months ago
• QuantScientist / DarkTorch
  ☆52Updated this week
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 2 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 3 years ago
• scailable / sclblonnx
  Scailable ONNX python tools
  ☆96Updated this week
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆61Updated 2 years ago
• VoVAllen / tf-dlpack
  DLPack for Tensorflow
  ☆36Updated 4 years ago
• intel / optimized-models
  ☆26Updated last year
• mosaicml / yahp
  hyperparameter management
  ☆43Updated last year
• facebookresearch / FAMBench
  Benchmarks to capture important workloads.
  ☆28Updated 3 months ago
• jiazhihao / sosp19ae
  Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions
  ☆21Updated 2 years ago
• ray-project / distml
  Distributed ML Optimizer
  ☆31Updated 3 years ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆58Updated 6 months ago
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆127Updated 2 years ago
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated last year
• octoml / synr
  A library for syntactically rewriting Python programs, pronounced (sinner).
  ☆70Updated 2 years ago
• mlcommons / logging
  MLPerf™ logging library
  ☆30Updated last week
• ezyang / stride-visualizer
  Stride visualizations
  ☆36Updated 6 years ago
• facebookresearch / torchrec
  ☆40Updated this week
• bwasti / pytorch_compiler_tutorial
  Codebase associated with the PyTorch compiler tutorial
  ☆44Updated 5 years ago