Alternatives and similar repositories for dynamic-batching-asyncio

Users that are interested in dynamic-batching-asyncio are comparing it to the libraries listed below

• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated 3 weeks ago
• philschmid / optimum-static-quantization
  ☆28Updated 2 years ago
• JulesBelveze / bert-squeeze
  🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
  ☆83Updated 6 months ago
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆42Updated last year
• qdrant / quaterion-models
  The collection of bulding blocks building fine-tunable metric learning models
  ☆32Updated last month
• cceyda / lit-NER
  TorchServe+Streamlit for easily serving your HuggingFace NER models
  ☆33Updated 2 years ago
• obss / trapper
  State-of-the-art NLP through transformer models in a modular design and consistent APIs.
  ☆45Updated 2 years ago
• PieterBlomme / proteus
  FastAPI for Triton
  ☆17Updated 2 years ago
• anton-l / wav2vec-toolkit
  A collection of scripts to preprocess ASR datasets and finetune language-specific Wav2Vec2 XLSR models
  ☆31Updated 4 years ago
• sgugger / torchdynamo-tests
  ☆19Updated 2 years ago
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆37Updated 2 years ago
• fidelity / stoke
  A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…
  ☆67Updated last year
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• philschmid / optimum-transformers-optimizations
  ☆30Updated 2 years ago
• sgugger / hf_examples
  NLP Examples using the 🤗 libraries
  ☆41Updated 4 years ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆58Updated last year
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• huggingface / hffs
  **ARCHIVED** Filesystem interface to 🤗 Hub
  ☆58Updated 2 years ago
• deep-diver / Continuous-Adaptation-for-Machine-Learning-System-to-Data-Changes
  https://blog.tensorflow.org/2021/12/continuous-adaptation-for-machine.html
  ☆29Updated 3 years ago
• nateraw / huggingface-hub-examples
  Examples using 🤗 Hub to share and reload machine learning models
  ☆32Updated 2 years ago
• aniketmaurya / stable_diffusion_inference
  Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).
  ☆17Updated last year
• soumik12345 / clip-lightning
  ☆19Updated 2 years ago
• PrithivirajDamodaran / vision-language-modelling-series
  Companion Repo for the Vision Language Modelling YouTube series - https://bit.ly/3PsbsC2 - by Prithivi Da. Open to PRs and collaborations
  ☆14Updated 2 years ago
• mtszkw / fast-torch
  Comparing PyTorch, JIT and ONNX for inference with Transformers
  ☆19Updated 4 years ago
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated last year
• PrithivirajDamodaran / Alt-ZSC
  Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP models…
  ☆36Updated 3 years ago
• nateraw / hf-hub-lightning
  A PyTorch Lightning Callback for pushing models to the Hugging Face Hub 🤗⚡️
  ☆36Updated 3 years ago
• philschmid / deep-learning-remote-runner
  ☆16Updated 2 years ago