FrancescoSaverioZuppichini / dynamic-batching-asyncioLinks
β32Updated 2 years ago
Alternatives and similar repositories for dynamic-batching-asyncio
Users that are interested in dynamic-batching-asyncio are comparing it to the libraries listed below
Sorting:
- π€ Trade any tensors over the networkβ30Updated 2 years ago
- β28Updated 2 years ago
- Management Dashboard for Torchserveβ125Updated 2 years ago
- Plugin for deploying MLflow models to TorchServeβ110Updated 2 years ago
- π οΈ Tools for Transformers compression using PyTorch Lightning β‘β85Updated last week
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.β33Updated 3 weeks ago
- Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).β17Updated 2 years ago
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and teβ¦β44Updated last year
- A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-β¦β67Updated 2 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.β95Updated 2 years ago
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.β159Updated last year
- A scalable & efficient active learning/data selection system for everyone.β217Updated last year
- This repository shows various ways of deploying a vision model (TensorFlow) from π€ Transformers.β30Updated 3 years ago
- The Triton backend for the PyTorch TorchScript models.β159Updated 2 weeks ago
- β20Updated 4 years ago
- NLP Examples using the π€ librariesβ40Updated 4 years ago
- Various transformers for FSDP researchβ38Updated 2 years ago
- **ARCHIVED** Filesystem interface to π€ Hubβ58Updated 2 years ago
- Article about deploying machine learning models using grpc, pytorch and asyncioβ29Updated 2 years ago
- Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)β117Updated 3 years ago
- β87Updated 3 years ago
- Check for data drift between two OpenAI multi-turn chat jsonl files.β37Updated last year
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scaleβ156Updated last year
- ClearML - Model-Serving Orchestration and Repository Solutionβ157Updated last week
- [WIP] A π₯ interface for running code in the cloudβ85Updated 2 years ago
- TorchServe+Streamlit for easily serving your HuggingFace NER modelsβ33Updated 3 years ago
- Scripts to convert datasets from various sources to Hugging Face Datasets.β57Updated 2 years ago
- Lite Inference Toolkit (LIT) for PyTorchβ161Updated 3 years ago
- A PyTorch Lightning Callback for pushing models to the Hugging Face Hub π€β‘οΈβ35Updated 3 years ago
- Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracyβ129Updated 2 years ago