EleutherAI / tqdm-multiprocessLinks
Using queues, tqdm-multiprocess supports multiple worker processes, each with multiple tqdm progress bars, displaying them cleanly through the main process. It offers similar functionality for python logging.
☆42Updated 4 years ago
Alternatives and similar repositories for tqdm-multiprocess
Users that are interested in tqdm-multiprocess are comparing it to the libraries listed below
Sorting:
- A library to instantiate any Python object from configuration files.☆24Updated 3 years ago
- A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…☆67Updated 2 years ago
- A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transfor…☆47Updated 2 years ago
- DEPRECATED--all functionality moved to nbdev☆15Updated 3 years ago
- A file utility for accessing both local and remote files through a unified interface.☆44Updated this week
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆35Updated last year
- A minimal template for creating a pypi package☆49Updated 5 years ago
- The elegant integration of huggingface/nlp and fastai2 and handy transforms using pure huggingface/nlp☆19Updated 5 years ago
- A case study of efficient training of large language models using commodity hardware.☆68Updated 3 years ago
- ☆30Updated 4 years ago
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)☆61Updated 2 years ago
- Automate issue discovery for your projects against Lightning nightly and releases.☆46Updated 7 months ago
- Vectorizers for a range of different data types☆103Updated 2 months ago
- ☆87Updated 3 years ago
- ☆15Updated 4 years ago
- Smoothly deprecate and redirect Python functions/classes with smart warnings and auto-routing—keep your codebase clean while maintaining …☆52Updated last week
- A diff tool for language models☆44Updated last year
- A library for squeakily cleaning and filtering language datasets.☆49Updated 2 years ago
- A library to create and manage configuration files, especially for machine learning projects.☆79Updated 3 years ago
- A Streamlit component for annotating text by text selecting.☆42Updated last year
- TorchServe+Streamlit for easily serving your HuggingFace NER models☆33Updated 3 years ago
- 🛠️ Tools for Transformers compression using PyTorch Lightning ⚡☆85Updated 2 weeks ago
- **ARCHIVED** Filesystem interface to 🤗 Hub☆58Updated 2 years ago
- Functional deep learning☆108Updated 3 years ago
- This repository contains example code to build models on TPUs☆30Updated 2 years ago
- ☆44Updated 2 years ago
- Tokenization across languages. Useful as preprocessing for subword tokenization.☆21Updated 2 years ago
- ☆31Updated last month
- Version control for software 2.0☆64Updated 4 years ago
- ☆78Updated 2 years ago