Alternatives and similar repositories for dynamic-batching-asyncio

Users that are interested in dynamic-batching-asyncio are comparing it to the libraries listed below

• JulesBelveze / bert-squeeze
  🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
  ☆84Updated 8 months ago
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆110Updated 2 years ago
• cceyda / torchserve-dashboard
  Management Dashboard for Torchserve
  ☆122Updated 2 years ago
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• fidelity / stoke
  A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…
  ☆67Updated last year
• philschmid / optimum-static-quantization
  ☆28Updated 2 years ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated 2 months ago
• PieterBlomme / proteus
  FastAPI for Triton
  ☆17Updated 3 years ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• clearml / clearml-serving
  ClearML - Model-Serving Orchestration and Repository Solution
  ☆151Updated 6 months ago
• HuaizhengZhang / Active-Learning-as-a-Service
  A scalable & efficient active learning/data selection system for everyone.
  ☆214Updated last year
• sayakpaul / deploy-hf-tf-vision-models
  This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.
  ☆30Updated 2 years ago
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆158Updated last year
• yandex-research / DeDLOC
  Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)
  ☆117Updated 3 years ago
• sayakpaul / FunMatch-Distillation
  TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237.
  ☆87Updated 3 years ago
• sgugger / hf_examples
  NLP Examples using the 🤗 libraries
  ☆41Updated 4 years ago
• FasterAI-Labs / fasterai
  FasterAI: Prune and Distill your models with FastAI and PyTorch
  ☆247Updated last month
• huggingface / hffs
  **ARCHIVED** Filesystem interface to 🤗 Hub
  ☆58Updated 2 years ago
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆29Updated 2 years ago
• jxtngx / lightning-lab
  deep learning with pytorch lightning
  ☆1Updated 8 months ago
• sgugger / torchdynamo-tests
  ☆19Updated 2 years ago
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆42Updated last year
• patrickvonplaten / Wav2Vec2_PyCTCDecode
  Small repo describing how to use Hugging Face's Wav2Vec2 with PyCTCDecode
  ☆111Updated 2 years ago
• anton-l / wav2vec-toolkit
  A collection of scripts to preprocess ASR datasets and finetune language-specific Wav2Vec2 XLSR models
  ☆31Updated 4 years ago
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆57Updated last year
• mtszkw / fast-torch
  Comparing PyTorch, JIT and ONNX for inference with Transformers
  ☆19Updated 4 years ago
• rasbt / cyclemoid-pytorch
  Cyclemoid implementation for PyTorch
  ☆90Updated 3 years ago
• lmnt-com / graftr
  graftr: an interactive shell to view and edit PyTorch checkpoints.
  ☆113Updated 4 years ago
• qdrant / quaterion-models
  The collection of bulding blocks building fine-tunable metric learning models
  ☆32Updated 3 months ago
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆155Updated last year