Alternatives and similar repositories for dynamic-batching-asyncio

Users that are interested in dynamic-batching-asyncio are comparing it to the libraries listed below

• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• JulesBelveze / bert-squeeze
  🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
  ☆84Updated 9 months ago
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆110Updated 2 years ago
• cceyda / torchserve-dashboard
  Management Dashboard for Torchserve
  ☆125Updated 2 years ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated 3 months ago
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆159Updated last year
• philschmid / optimum-static-quantization
  ☆28Updated 2 years ago
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆42Updated last year
• comet-ml / blog-serving-hugging-face-models
  ☆20Updated 4 years ago
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆29Updated 2 years ago
• bentoml / aws-lambda-deploy
  Fast model deployment on AWS Lambda
  ☆14Updated last year
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• aniketmaurya / stable_diffusion_inference
  Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).
  ☆17Updated 2 years ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆158Updated 3 weeks ago
• sayakpaul / deploy-hf-tf-vision-models
  This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.
  ☆30Updated 3 years ago
• clearml / clearml-serving
  ClearML - Model-Serving Orchestration and Repository Solution
  ☆155Updated last month
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆38Updated 2 years ago
• fidelity / stoke
  A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…
  ☆67Updated 2 years ago
• rasbt / faster-pytorch-blog
  Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy
  ☆128Updated 2 years ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆63Updated last year
• anton-l / wav2vec-toolkit
  A collection of scripts to preprocess ASR datasets and finetune language-specific Wav2Vec2 XLSR models
  ☆31Updated 4 years ago
• MagedSaeed / generate-sequences
  A python package made to generate sequences (greedy and beam-search) from Pytorch (not necessarily HF transformers) models.
  ☆17Updated 2 weeks ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• sgugger / hf_examples
  NLP Examples using the 🤗 libraries
  ☆40Updated 4 years ago
• legacyai / tf-transformers
  State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).
  ☆85Updated 2 years ago
• sgugger / torchdynamo-tests
  ☆19Updated 2 years ago
• nateraw / hf-hub-lightning
  A PyTorch Lightning Callback for pushing models to the Hugging Face Hub 🤗⚡️
  ☆36Updated 3 years ago
• huggingface / hffs
  **ARCHIVED** Filesystem interface to 🤗 Hub
  ☆58Updated 2 years ago
• soumik12345 / clip-lightning
  ☆19Updated 3 years ago
• s-aravindh / multiocr
  MultiOCR, an interface that connects multiple open-source OCR and various Cloud OCR.
  ☆31Updated 2 years ago