Alternatives and similar repositories for dynamic-batching-asyncio

Users that are interested in dynamic-batching-asyncio are comparing it to the libraries listed below

• JulesBelveze / bert-squeeze
  🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
  ☆85Updated last week
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated 2 years ago
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆110Updated 2 years ago
• cceyda / torchserve-dashboard
  Management Dashboard for Torchserve
  ☆125Updated 2 years ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆96Updated 2 years ago
• philschmid / optimum-static-quantization
  ☆28Updated 2 years ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆32Updated 4 months ago
• obss / jury
  Comprehensive NLP Evaluation System
  ☆188Updated last year
• obss / trapper
  State-of-the-art NLP through transformer models in a modular design and consistent APIs.
  ☆47Updated 2 years ago
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆30Updated 3 years ago
• comet-ml / blog-serving-hugging-face-models
  ☆20Updated 4 years ago
• huggingface / hffs
  **ARCHIVED** Filesystem interface to 🤗 Hub
  ☆58Updated 2 years ago
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆157Updated 2 years ago
• fidelity / stoke
  A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…
  ☆67Updated 2 years ago
• cceyda / lit-NER
  TorchServe+Streamlit for easily serving your HuggingFace NER models
  ☆33Updated 3 years ago
• qanastek / HugsVision
  HugsVision is a easy to use huggingface wrapper for state-of-the-art computer vision
  ☆198Updated 2 years ago
• sgugger / hf_examples
  NLP Examples using the 🤗 libraries
  ☆40Updated 4 years ago
• legacyai / tf-transformers
  State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).
  ☆85Updated 2 years ago
• AlekseyKorshuk / optimum-transformers
  Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.
  ☆126Updated 3 years ago
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆160Updated last year
• huggingface / fuego
  [WIP] A 🔥 interface for running code in the cloud
  ☆86Updated 2 years ago
• philschmid / optimum-transformers-optimizations
  ☆30Updated 3 years ago
• mariosasko / datasets_sql
  Execute arbitrary SQL queries on 🤗 Datasets
  ☆32Updated 2 years ago
• aniketmaurya / stable_diffusion_inference
  Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).
  ☆17Updated 2 years ago
• nateraw / huggingface-datasets-converter
  Scripts to convert datasets from various sources to Hugging Face Datasets.
  ☆57Updated 3 years ago
• clearml / clearml-serving
  ClearML - Model-Serving Orchestration and Repository Solution
  ☆161Updated 3 weeks ago
• patil-suraj / onnx_transformers
  Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.
  ☆127Updated 5 years ago
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆44Updated 2 years ago
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆56Updated 2 years ago
• qdrant / quaterion-models
  The collection of bulding blocks building fine-tunable metric learning models
  ☆35Updated 3 weeks ago