bigscience-workshop / data_sourcingLinks
This directory gathers the tools developed by the Data Sourcing Working Group
☆31Updated 4 years ago
Alternatives and similar repositories for data_sourcing
Users that are interested in data_sourcing are comparing it to the libraries listed below
Sorting:
- Transcribing audio files using Hugging Face's implementation of Wav2Vec2 + "chain-linking" NLP tasks to combine speech-to-text with downs…☆32Updated 4 years ago
- A PyTorch Lightning Callback for pushing models to the Hugging Face Hub 🤗⚡️☆35Updated 3 years ago
- Viewer for the 🤗 datasets library.☆86Updated 4 years ago
- Scripts to convert datasets from various sources to Hugging Face Datasets.☆57Updated 3 years ago
- classy is a simple-to-use library for building high-performance Machine Learning models in NLP.☆87Updated last month
- ☆87Updated 3 years ago
- Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.☆127Updated 4 years ago
- A library to synthesize text datasets using Large Language Models (LLM)☆152Updated 2 years ago
- Label data using HuggingFace's transformers and automatically get a prediction service☆193Updated 2 years ago
- A collection of scripts to preprocess ASR datasets and finetune language-specific Wav2Vec2 XLSR models☆31Updated 4 years ago
- A minimal template for creating a pypi package☆49Updated 5 years ago
- ☆115Updated last month
- This is the second part of the Deep Learning Course for the Master in High-Performance Computing (SISSA/ICTP).)☆33Updated 5 years ago
- Few-shot Named Entity Recognition☆123Updated 3 years ago
- TimeLMs: Diachronic Language Models from Twitter☆111Updated last year
- Small repo describing how to use Hugging Face's Wav2Vec2 with PyCTCDecode☆111Updated 3 years ago
- Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP models…☆37Updated 3 years ago
- Hashformers is a framework for hashtag segmentation with Transformers and Large Language Models (LLMs).☆76Updated last month
- Execute arbitrary SQL queries on 🤗 Datasets☆32Updated last year
- A Streamlit app to add structured tags to a dataset card☆22Updated 3 years ago
- Comprehensive NLP Evaluation System☆188Updated last year
- Explainable Zero-Shot Topic Extraction☆64Updated last year
- 🛠️ Tools for Transformers compression using PyTorch Lightning ⚡☆85Updated 3 weeks ago
- A comprehensive tool for linguistic analysis of communities☆49Updated 4 years ago
- Asent is a python library for performing efficient and transparent sentiment analysis using spaCy.☆120Updated last month
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale☆157Updated last year
- An easy-to-use Python module that helps you to extract the BERT embeddings for a large text dataset (Bengali/English) efficiently.☆36Updated 2 years ago
- NLP Examples using the 🤗 libraries☆40Updated 4 years ago
- An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.☆86Updated 4 years ago
- TorchServe+Streamlit for easily serving your HuggingFace NER models☆33Updated 3 years ago