Alternatives and similar repositories for serve:

Users that are interested in serve are comparing it to the libraries listed below

• triton-inference-server / server
  The Triton Inference Server provides an optimized cloud and edge inferencing solution.
  ☆8,926Updated this week
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,278Updated 2 months ago
• horovod / horovod
  Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
  ☆14,423Updated last month
• NVIDIA / apex
  A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
  ☆8,585Updated this week
• bentoml / BentoML
  The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
  ☆7,481Updated this week
• arogozhnikov / einops
  Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)
  ☆8,796Updated last month
• NVIDIA / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆6,084Updated 11 months ago
• pytorch / TensorRT
  PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
  ☆2,711Updated this week
• huggingface / accelerate
  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…
  ☆8,497Updated this week
• uber / petastorm
  Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…
  ☆1,822Updated last year
• ELS-RD / transformer-deploy
  Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
  ☆1,680Updated 4 months ago
• pytorch / captum
  Model interpretability and understanding for PyTorch
  ☆5,126Updated last week
• Lightning-AI / torchmetrics
  Machine learning metrics for distributed, scalable PyTorch applications.
  ☆2,228Updated this week
• pytorch / ignite
  High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
  ☆4,598Updated this week
• google / flax
  Flax is a neural network library for JAX that is designed for flexibility.
  ☆6,421Updated this week
• Lightning-AI / pytorch-lightning
  Pretrain, finetune ANY AI model of ANY size on multiple GPUs, TPUs with zero code changes.
  ☆29,161Updated this week
• onnx / tutorials
  Tutorials for creating and using ONNX models
  ☆3,469Updated 8 months ago
• bytedance / lightseq
  LightSeq: A High Performance Library for Sequence Processing and Generation
  ☆3,259Updated last year
• jessevig / bertviz
  BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
  ☆7,237Updated last year
• google / sentencepiece
  Unsupervised text tokenizer for Neural Network-based text generation.
  ☆10,707Updated 2 weeks ago
• SeldonIO / seldon-core
  An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
  ☆4,488Updated this week
• microsoft / nni
  An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model c…
  ☆14,153Updated 8 months ago
• tensorflow / tfx
  TFX is an end-to-end platform for deploying production ML pipelines
  ☆2,136Updated last week
• facebookresearch / mmf
  A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
  ☆5,552Updated this week
• pytorch / xla
  Enabling PyTorch on XLA Devices (e.g. Google TPU)
  ☆2,568Updated this week
• optuna / optuna
  A hyperparameter optimization framework
  ☆11,583Updated this week
• catalyst-team / catalyst
  Accelerated deep learning R&D
  ☆3,336Updated last year
• skorch-dev / skorch
  A scikit-learn compatible neural network library that wraps PyTorch
  ☆5,986Updated last week
• jettify / pytorch-optimizer
  torch-optimizer -- collection of optimizers for Pytorch
  ☆3,092Updated 11 months ago
• NVIDIA / TensorRT
  NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…
  ☆11,350Updated last week