EleutherAI / tqdm-multiprocess
Using queues, tqdm-multiprocess supports multiple worker processes, each with multiple tqdm progress bars, displaying them cleanly through the main process. It offers similar functionality for python logging.
☆41Updated 3 years ago
Related projects: ⓘ
- A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transfor…☆47Updated last year
- A file utility for accessing both local and remote files through a unified interface.☆36Updated last month
- A library to instantiate any Python object from configuration files.☆24Updated last year
- An extension package of 🤗 Datasets that provides support for executing arbitrary SQL queries on HF datasets☆31Updated 7 months ago
- **ARCHIVED** Filesystem interface to 🤗 Hub☆56Updated last year
- PyTorch implementation of GLOM☆21Updated 2 years ago
- Automate issue discovery for your projects against Lightning nightly and releases.☆45Updated last week
- Simplifying parsing of large jsonline files in NLP Workflows☆12Updated 2 years ago
- Implementation of N-Grammer in Flax☆16Updated last year
- An easy way to start a python programming environment using GitHub Codespaces.☆15Updated 4 years ago
- DEPRECATED--all functionality moved to nbdev☆15Updated 2 years ago
- Test pytorch code with minimal computational overhead☆25Updated last year
- ☆31Updated last year
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆91Updated last year
- Using short models to classify long texts☆20Updated last year
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)☆59Updated last year
- 🛠️ Tools for Transformers compression using PyTorch Lightning ⚡☆77Updated 6 months ago
- TorchServe+Streamlit for easily serving your HuggingFace NER models☆31Updated 2 years ago
- ☆15Updated this week
- The elegant integration of huggingface/nlp and fastai2 and handy transforms using pure huggingface/nlp☆19Updated 3 years ago
- A Python library for creating adversarial splits☆13Updated 2 years ago
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆50Updated 2 years ago
- Embedding Recycling for Language models☆38Updated last year
- Source code and data for Like a Good Nearest Neighbor☆28Updated 7 months ago
- Large dataset storage format for Pytorch☆45Updated 3 years ago
- In-place debugger for the fastai library and pytorch☆28Updated 3 years ago
- URL downloader supporting checkpointing and continuous checksumming.☆19Updated 9 months ago
- A minimal template for creating a pypi package☆49Updated 3 years ago
- GPU-Parallelized UMAP☆49Updated 5 years ago
- A Streamlit component for annotating text by text selecting.☆39Updated 3 months ago