Alternatives and similar repositories for serve

Users that are interested in serve are comparing it to the libraries listed below

• triton-inference-server / server
  The Triton Inference Server provides an optimized cloud and edge inferencing solution.
  ☆9,184Updated this week
• NVIDIA / apex
  A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
  ☆8,650Updated this week
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,313Updated 2 weeks ago
• pytorch / TensorRT
  PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
  ☆2,745Updated this week
• NVIDIA / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆6,147Updated last year
• huggingface / accelerate
  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…
  ☆8,693Updated this week
• horovod / horovod
  Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
  ☆14,464Updated 3 weeks ago
• pytorch / ignite
  High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
  ☆4,655Updated this week
• pytorch / xla
  Enabling PyTorch on XLA Devices (e.g. Google TPU)
  ☆2,599Updated this week
• microsoft / hummingbird
  Hummingbird compiles trained ML models into tensor computation for faster inference.
  ☆3,438Updated 3 weeks ago
• arogozhnikov / einops
  Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)
  ☆8,892Updated 2 weeks ago
• apache / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆12,259Updated this week
• google / flax
  Flax is a neural network library for JAX that is designed for flexibility.
  ☆6,539Updated this week
• ahkarami / Deep-Learning-in-Production
  In this repository, I will share some useful notes and references about deploying deep learning-based models in production.
  ☆4,342Updated 6 months ago
• microsoft / onnxruntime
  ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
  ☆16,490Updated this week
• google / automl
  Google Brain AutoML
  ☆6,363Updated 2 months ago
• ELS-RD / transformer-deploy
  Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
  ☆1,683Updated 6 months ago
• NVIDIA / DALI
  A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…
  ☆5,392Updated this week
• NVIDIA / Megatron-LM
  Ongoing research training transformer models at scale
  ☆12,310Updated this week
• NVIDIA-AI-IOT / torch2trt
  An easy to use PyTorch to TensorRT converter
  ☆4,732Updated 8 months ago
• pytorch / captum
  Model interpretability and understanding for PyTorch
  ☆5,202Updated this week
• rapidsai / cuml
  cuML - RAPIDS Machine Learning Library
  ☆4,690Updated this week
• onnx / tutorials
  Tutorials for creating and using ONNX models
  ☆3,509Updated 9 months ago
• facebookresearch / mmf
  A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
  ☆5,562Updated 2 weeks ago
• bentoml / BentoML
  The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
  ☆7,685Updated this week
• facebookresearch / vissl
  VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.
  ☆3,283Updated last year
• onnx / onnx
  Open standard for machine learning interoperability
  ☆18,915Updated this week
• lukemelas / EfficientNet-PyTorch
  A PyTorch implementation of EfficientNet
  ☆8,098Updated 3 years ago
• Lightning-Universe / lightning-bolts
  Toolbox of models, callbacks, and datasets for AI/ML researchers.
  ☆1,723Updated last week
• Dao-AILab / flash-attention
  Fast and memory-efficient exact attention
  ☆17,259Updated last week