FrancescoSaverioZuppichini / dynamic-batching-asyncio

Related projects ⓘ

Alternatives and complementary repositories for dynamic-batching-asyncio

• philschmid / optimum-static-quantization
  ☆27Updated last year
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• JulesBelveze / bert-squeeze
  🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
  ☆79Updated this week
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆32Updated 2 months ago
• PieterBlomme / proteus
  FastAPI for Triton
  ☆16Updated 2 years ago
• sayakpaul / deploy-hf-tf-vision-models
  This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.
  ☆29Updated 2 years ago
• s-aravindh / multiocr
  MultiOCR, an interface that connects multiple open-source OCR and various Cloud OCR.
  ☆31Updated last year
• huggingface / hffs
  **ARCHIVED** Filesystem interface to 🤗 Hub
  ☆56Updated last year
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆24Updated last year
• qdrant / quaterion-models
  The collection of bulding blocks building fine-tunable metric learning models
  ☆32Updated last month
• aniketmaurya / stable_diffusion_inference
  Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).
  ☆16Updated last year
• anton-l / wav2vec-toolkit
  A collection of scripts to preprocess ASR datasets and finetune language-specific Wav2Vec2 XLSR models
  ☆31Updated 3 years ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• huggingface / pixparse
  Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data
  ☆13Updated 3 months ago
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆105Updated last year
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆48Updated this week
• huggingface / open_asr_leaderboard
  ☆51Updated last week
• mtszkw / fast-torch
  Comparing PyTorch, JIT and ONNX for inference with Transformers
  ☆17Updated 3 years ago
• soumik12345 / clip-lightning
  ☆19Updated 2 years ago
• fidelity / stoke
  A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…
  ☆66Updated last year
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆42Updated 9 months ago
• sgugger / torchdynamo-tests
  ☆20Updated last year
• LukeWood / reef-net
  ☆24Updated 2 years ago
• comet-ml / blog-serving-hugging-face-models
  ☆19Updated 3 years ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆20Updated last year
• sgugger / hf_examples
  NLP Examples using the 🤗 libraries
  ☆42Updated 3 years ago
• cceyda / lit-NER
  TorchServe+Streamlit for easily serving your HuggingFace NER models
  ☆31Updated 2 years ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆53Updated 7 months ago
• cceyda / torchserve-dashboard
  Management Dashboard for Torchserve
  ☆121Updated last year