Alternatives and similar repositories for serve:

Users that are interested in serve are comparing it to the libraries listed below

• triton-inference-server / server
  The Triton Inference Server provides an optimized cloud and edge inferencing solution.
  ☆9,157Updated this week
• NVIDIA / apex
  A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
  ☆8,645Updated 3 weeks ago
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,308Updated last week
• horovod / horovod
  Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
  ☆14,459Updated 2 weeks ago
• pytorch / TensorRT
  PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
  ☆2,738Updated this week
• arogozhnikov / einops
  Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)
  ☆8,882Updated last week
• pytorch / ignite
  High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
  ☆4,651Updated last week
• huggingface / accelerate
  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…
  ☆8,673Updated this week
• pytorch / captum
  Model interpretability and understanding for PyTorch
  ☆5,195Updated this week
• NVIDIA / DALI
  A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…
  ☆5,378Updated this week
• NVIDIA / Megatron-LM
  Ongoing research training transformer models at scale
  ☆12,261Updated this week
• SeldonIO / seldon-core
  An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
  ☆4,511Updated last week
• onnx / onnx
  Open standard for machine learning interoperability
  ☆18,875Updated last week
• skorch-dev / skorch
  A scikit-learn compatible neural network library that wraps PyTorch
  ☆6,014Updated last week
• lanpa / tensorboardX
  tensorboard for pytorch (and chainer, mxnet, numpy, ...)
  ☆7,933Updated this week
• bentoml / BentoML
  The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
  ☆7,669Updated this week
• ELS-RD / transformer-deploy
  Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
  ☆1,683Updated 6 months ago
• apache / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆12,251Updated this week
• NVIDIA / DeepLearningExamples
  State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enter…
  ☆14,211Updated 8 months ago
• google / sentencepiece
  Unsupervised text tokenizer for Neural Network-based text generation.
  ☆10,836Updated last month
• uber / petastorm
  Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…
  ☆1,832Updated last year
• NVIDIA / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆6,144Updated last year
• google / flax
  Flax is a neural network library for JAX that is designed for flexibility.
  ☆6,527Updated this week
• aimhubio / aim
  Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
  ☆5,543Updated this week
• determined-ai / determined
  Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, …
  ☆3,139Updated last month
• Lightning-AI / torchmetrics
  Machine learning metrics for distributed, scalable PyTorch applications.
  ☆2,258Updated last week
• daquexian / onnx-simplifier
  Simplify your onnx model
  ☆4,065Updated 8 months ago
• mlflow / mlflow
  Open source platform for the machine learning lifecycle
  ☆20,362Updated this week
• onnx / tutorials
  Tutorials for creating and using ONNX models
  ☆3,504Updated 9 months ago
• facebookincubator / AITemplate
  AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (N…
  ☆4,630Updated last month