FrancescoSaverioZuppichini / dynamic-batching-asyncioLinks
β32Updated 2 years ago
Alternatives and similar repositories for dynamic-batching-asyncio
Users that are interested in dynamic-batching-asyncio are comparing it to the libraries listed below
Sorting:
- π€ Trade any tensors over the networkβ30Updated last year
- β28Updated 2 years ago
- π οΈ Tools for Transformers compression using PyTorch Lightning β‘β84Updated 8 months ago
- Plugin for deploying MLflow models to TorchServeβ111Updated 2 years ago
- Management Dashboard for Torchserveβ124Updated 2 years ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.β33Updated 2 months ago
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and teβ¦β42Updated last year
- Various transformers for FSDP researchβ37Updated 2 years ago
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.β158Updated last year
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.β93Updated 2 years ago
- A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-β¦β67Updated 2 years ago
- ML/DL Math and Method notesβ62Updated last year
- Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracyβ128Updated 2 years ago
- FasterAI: Prune and Distill your models with FastAI and PyTorchβ248Updated last month
- Article about deploying machine learning models using grpc, pytorch and asyncioβ29Updated 2 years ago
- Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).β17Updated 2 years ago
- A scalable & efficient active learning/data selection system for everyone.β214Updated last year
- Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)β117Updated 3 years ago
- NLP Examples using the π€ librariesβ41Updated 4 years ago
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scaleβ155Updated last year
- Check for data drift between two OpenAI multi-turn chat jsonl files.β37Updated last year
- State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).β85Updated 2 years ago
- [WIP] A π₯ interface for running code in the cloudβ85Updated 2 years ago
- **ARCHIVED** Filesystem interface to π€ Hubβ58Updated 2 years ago
- β19Updated 2 years ago
- TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237.β87Updated 3 years ago
- experiments with inference on llamaβ104Updated last year
- ClearML - Model-Serving Orchestration and Repository Solutionβ152Updated 2 weeks ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning Pβ¦β34Updated last year
- The Triton backend for the PyTorch TorchScript models.β158Updated this week