EleutherAI / tqdm-multiprocessLinks
Using queues, tqdm-multiprocess supports multiple worker processes, each with multiple tqdm progress bars, displaying them cleanly through the main process. It offers similar functionality for python logging.
☆42Updated 5 years ago
Alternatives and similar repositories for tqdm-multiprocess
Users that are interested in tqdm-multiprocess are comparing it to the libraries listed below
Sorting:
- A library to instantiate any Python object from configuration files.☆24Updated 3 years ago
- A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transfor…☆47Updated 2 years ago
- A minimal template for creating a pypi package☆49Updated 5 years ago
- A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…☆67Updated 2 years ago
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆35Updated last year
- A file utility for accessing both local and remote files through a unified interface.☆46Updated last month
- 🛠️ Tools for Transformers compression using PyTorch Lightning ⚡☆85Updated this week
- TorchServe+Streamlit for easily serving your HuggingFace NER models☆33Updated 3 years ago
- ☆30Updated 4 years ago
- Streamlit demo app to demonstrate the features of transformers interpret with multiple models.☆25Updated 4 years ago
- Functional deep learning☆108Updated 3 years ago
- Automate issue discovery for your projects against Lightning nightly and releases.☆46Updated 8 months ago
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)☆61Updated 2 years ago
- ☆87Updated 3 years ago
- URL downloader supporting checkpointing and continuous checksumming.☆19Updated 2 years ago
- The elegant integration of huggingface/nlp and fastai2 and handy transforms using pure huggingface/nlp☆19Updated 5 years ago
- A case study of efficient training of large language models using commodity hardware.☆68Updated 3 years ago
- Smoothly deprecate and redirect Python functions/classes with smart warnings and auto-routing—keep your codebase clean while maintaining …☆52Updated last week
- A diff tool for language models☆44Updated 2 years ago
- DEPRECATED--all functionality moved to nbdev☆15Updated 3 years ago
- Management Dashboard for Torchserve☆125Updated 2 years ago
- A queue service for quickly developing scripts that use all your GPUs efficiently☆88Updated 3 years ago
- Version control for software 2.0☆64Updated 4 years ago
- Confection: the sweetest config system for Python☆192Updated last month
- A Streamlit component for annotating text by text selecting.☆42Updated last year
- ☆44Updated 2 years ago
- Viewer for the 🤗 datasets library.☆86Updated 4 years ago
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…☆44Updated last year
- Tokenization across languages. Useful as preprocessing for subword tokenization.☆21Updated 2 years ago
- Parallel data preprocessing for NLP and ML.☆34Updated last year