Alternatives and similar repositories for serve:

Users that are interested in serve are comparing it to the libraries listed below

• triton-inference-server / server
  The Triton Inference Server provides an optimized cloud and edge inferencing solution.
  ☆8,742Updated this week
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,259Updated last month
• NVIDIA / apex
  A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
  ☆8,534Updated last week
• pytorch / TensorRT
  PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
  ☆2,676Updated this week
• pytorch / xla
  Enabling PyTorch on XLA Devices (e.g. Google TPU)
  ☆2,526Updated this week
• huggingface / accelerate
  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…
  ☆8,325Updated this week
• horovod / horovod
  Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
  ☆14,385Updated 2 weeks ago
• pytorch / captum
  Model interpretability and understanding for PyTorch
  ☆5,079Updated 3 weeks ago
• pytorch / ignite
  High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
  ☆4,584Updated last month
• bentoml / BentoML
  The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
  ☆7,374Updated this week
• onnx / onnx
  Open standard for machine learning interoperability
  ☆18,432Updated this week
• arogozhnikov / einops
  Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)
  ☆8,735Updated last week
• google / flax
  Flax is a neural network library for JAX that is designed for flexibility.
  ☆6,333Updated this week
• NVIDIA / TensorRT
  NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…
  ☆11,180Updated 2 weeks ago
• NVIDIA / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆6,022Updated 10 months ago
• google-research / text-to-text-transfer-transformer
  Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"
  ☆6,267Updated 4 months ago
• huggingface / tokenizers
  💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
  ☆9,378Updated this week
• lanpa / tensorboardX
  tensorboard for pytorch (and chainer, mxnet, numpy, ...)
  ☆7,913Updated last month
• facebookincubator / AITemplate
  AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (N…
  ☆4,596Updated 2 months ago
• microsoft / hummingbird
  Hummingbird compiles trained ML models into tensor computation for faster inference.
  ☆3,385Updated 3 weeks ago
• Lightning-AI / pytorch-lightning
  Pretrain, finetune ANY AI model of ANY size on multiple GPUs, TPUs with zero code changes.
  ☆28,990Updated this week
• jessevig / bertviz
  BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
  ☆7,130Updated last year
• skorch-dev / skorch
  A scikit-learn compatible neural network library that wraps PyTorch
  ☆5,963Updated 2 weeks ago
• clearml / clearml
  ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling …
  ☆5,821Updated this week
• Lightning-AI / torchmetrics
  Machine learning metrics for distributed, scalable PyTorch applications.
  ☆2,207Updated this week
• mlflow / mlflow
  Open source platform for the machine learning lifecycle
  ☆19,486Updated this week
• allenai / allennlp
  An open-source NLP research library, built on PyTorch.
  ☆11,804Updated 2 years ago
• NVIDIA-AI-IOT / torch2trt
  An easy to use PyTorch to TensorRT converter
  ☆4,674Updated 6 months ago
• NVIDIA / DALI
  A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…
  ☆5,276Updated this week
• SeldonIO / seldon-core
  An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
  ☆4,448Updated this week